Supplemental information for ‘Tutorial on survival modelling with omics data’
Zhi Zhao and John Zobolas
Last updated: 17 February, 2023
This is an R Markdown
supplement for the article Tutorial on survival modelling
with omics data.
Introduction
The Cancer Genome Atlas (TCGA) provides an enormous collection of cancer data sets, including survival, clinical and multi-omics data.
We will use TCGA data to demonstrate:
- The different data types
- Preprocessing of survival and omics data
- Analysis of survival data by classical statistical methods
- Unsupervised learning for omics data
- Frequentist & Bayesian supervised learning for survival and omics data
TCGA survival and clinical data
The R/Bioconductor package TCGAbiolinks (Mounir 2019) provides a few functions to download and preprocess clinical and multi-omics data from the Genomic Data Commons (GDC) Data Portal for further analysis.
First we load all necessary libraries used in this tutorial except mlr3 libraries which will be
introduced later. Then we use function GDCquery_clinic()
from TCGAbiolinks package to query and download TCGA
survival and clinical data from multiple cancer types:
# load all libraries used in this tutorial except mlr3
library("TCGAbiolinks")
library("SummarizedExperiment")
library("DESeq2")
library("dplyr")
library("ggplot2")
library("survival")
library("survminer")
library("M3C")
library("glmnet")
library("plotmo")
library("grpreg")
library("SGL")
library("psbcGroup")
library("GGally")
library("BhGLM")
library("risksetROC")
library("riskRegression")
library("peperr")
library("c060")
library("rms")
library("survAUC")
library("regplot")# download the clinical data and extract data for multiple cancers using GDC api method
cancer_types = c("TCGA-BLCA", "TCGA-BRCA", "TCGA-COAD", "TCGA-LIHC",
"TCGA-LUAD", "TCGA-PAAD", "TCGA-PRAD", "TCGA-THCA")
clin = NULL
for (i in seq_along(cancer_types)) {
tmp = TCGAbiolinks::GDCquery_clinic(project = cancer_types[i], type = "clinical")
clin = rbind(clin, tmp[, c("project", "submitter_id", "vital_status",
"days_to_last_follow_up", "days_to_death",
"age_at_diagnosis", "gender", "race",
"ethnicity", "ajcc_pathologic_t")])
}
# extract the observed time for each patient and use years as unit
clin$time = apply(clin[, c("days_to_death", "days_to_last_follow_up")], 1, max, na.rm = TRUE) / 365.25
clin$age = clin$age_at_diagnosis / 365.25
clin$status = clin$vital_status
clin = clin[, c("project", "submitter_id", "status", "time", "gender", "age", "race", "ethnicity")]
clin = clin[(clin$time > 0) & (clin$status %in% c("Alive", "Dead")), ]
# frequency table of the patients w.r.t. status, gender and ethnicity
clin %>%
count(status, gender, ethnicity) %>%
group_by(status) %>%
mutate(prop = prop.table(n))# A tibble: 12 × 5
# Groups: status [2]
status gender ethnicity n prop
<chr> <chr> <chr> <int> <dbl>
1 Alive female hispanic or latino 75 0.0240
2 Alive female not hispanic or latino 1367 0.438
3 Alive female not reported 328 0.105
4 Alive male hispanic or latino 34 0.0109
5 Alive male not hispanic or latino 1041 0.334
6 Alive male not reported 276 0.0884
7 Dead female hispanic or latino 7 0.00809
8 Dead female not hispanic or latino 377 0.436
9 Dead female not reported 64 0.0740
10 Dead male hispanic or latino 10 0.0116
11 Dead male not hispanic or latino 327 0.378
12 Dead male not reported 80 0.0925 # censoring plot by cancer types
clin %>%
mutate(index=1:n()) %>%
ggplot(
aes(y = index, x = time, colour = project, shape = factor(status))) +
geom_segment(aes(x = time, y = index, xend = 0, yend = index)) +
geom_point() +
ggtitle("") +
labs(x="Years", y="Patients") +
scale_shape_discrete(name = "Status", labels = c("Censored","Dead")) +
scale_color_discrete(name = "Cancer",
labels = c("Bladder","Breast","Colon","Liver", "Lung adeno",
"Pancreatic", "Prostate","Thyroid")) +
theme(legend.position="top", legend.direction="vertical") +
guides(color = guide_legend(nrow = 2, byrow = TRUE))
Overall survival times and status of pan-cancer patients from TCGA.
TCGA omics data
We use function GDCquery() to query and use
GDCdownload() and GDCprepare() to download
TCGA omics data from one cancer type (breast cancer). The argument
data.category in function GDCquery() specifies
the type of omics data, such as "Copy Number Variation",
"DNA Methylation", "Transcriptome Profiling",
"Simple Nucleotide Variation". Note that the downloaded
omics data are accompanied by metadata including survival outcomes,
clinical and demographic variables. The accompanied metadata are almost
the same as the clinical data downloaded via
GDCquery_clinic() in the previous section but here only
corresponding to one cancer type.
# download TCGA breast cancer (BRCA) mRNA-Seq data using GDC api method
query = TCGAbiolinks::GDCquery(project = "TCGA-BRCA",
data.category = "Transcriptome Profiling",
data.type = "Gene Expression Quantification",
workflow.type = "STAR - Counts",
experimental.strategy = "RNA-Seq",
sample.type = c("Primary Tumor"))
TCGAbiolinks::GDCdownload(query = query, method = "api")
dat = TCGAbiolinks::GDCprepare(query = query)
SummarizedExperiment::assays(dat)$unstranded[1:5, 1:2] TCGA-LL-A73Y-01A-11R-A33J-07 TCGA-E2-A1IU-01A-11R-A14D-07
ENSG00000000003.15 7015 850
ENSG00000000005.6 16 5
ENSG00000000419.13 2167 1680
ENSG00000000457.14 2505 1559
ENSG00000000460.17 726 402It is recommended to use DESeq2 or TMM normalization method for RNA-seq data before further statistical analysis (Zhao et al. 2021). Here we demonstrate how to use the R/Bioconductor package DESeq2 (Love, Huber, and Anders 2014) to normalize the RNA count data.
meta = colData(dat)[, c("project_id", "submitter_id", "age_at_diagnosis", "ethnicity", "gender", "days_to_death", "days_to_last_follow_up", "vital_status", "paper_BRCA_Subtype_PAM50")]
dds = DESeq2::DESeqDataSetFromMatrix(assays(dat)$unstranded, colData = meta, design = ~ 1)
dds2 = DESeq2::estimateSizeFactors(dds)
RNA_count = DESeq2::counts(dds2, normalized=TRUE)
RNA_count[1:5, 1:2] TCGA-LL-A73Y-01A-11R-A33J-07 TCGA-E2-A1IU-01A-11R-A14D-07
ENSG00000000003.15 6034.27168 951.825764
ENSG00000000005.6 13.76313 5.598975
ENSG00000000419.13 1864.04373 1881.255628
ENSG00000000457.14 2154.78982 1745.760431
ENSG00000000460.17 624.50196 450.157597To perform survival analysis with both clinical/demographic variables and omics data, in the following code we extract female breast cancer patients with their corresponding survival outcomes, clinical/demographic variables and RNA-seq features.
meta$time = apply(meta[, c("days_to_death", "days_to_last_follow_up")], 1, max, na.rm = TRUE) / 365.25
meta$status = meta$vital_status
meta$age = meta$age_at_diagnosis / 365.25
clin = subset(meta, gender == "female" & !duplicated(submitter_id) & time > 0 & !is.na(age))
clin = clin[order(clin$submitter_id), ]
RNA_count = RNA_count[, rownames(clin)]The R/Bioconductor package TCGAbiolinks cannot retrieve any proteomics or metabolomics data. It is always useful to look at your data first, in particular the data type and dimensions (i.e. numbers of rows and columns for a data frame or matrix).
Univariate analysis
Nonparametric survival analysis
For the data of TCGA breast cancer patients that we extracted in the
previous section, Kaplan-Meier estimates of the survival probabilities
can be obtained via function survfit() from survival
package. The dashed lines in the following figure indicate the median
survival time.
# Kaplan-Meier (KM) estimation
clin$status[clin$status == "Dead"] = 1
clin$status[clin$status == "Alive"] = 0
clin$status = as.numeric(clin$status)
sfit = survival::survfit(Surv(time, status) ~ 1, data = clin)
# calculate survival probability at 1-, 3- and 5-year time points
summary(sfit, times=c(1,3,5))
theme_set(theme_bw())
survminer::ggsurvplot(sfit, conf.int = TRUE, risk.table = TRUE,
xlab = "Time since diagnosis (year)",legend = "none",
surv.median.line = "hv")
Kaplan-Meier curve for 1061 BRCA patients data from TCGA.
To compare the survival curves of two groups of patients, for
example, age\(<60\) vs age\(\ge 60\), the R function
survival::survdiff() can perform the log-rank test to
compare two survival curves. Alternatively, the R function
survival::survfit with a formula including the age group as
a covariate can return the (KM) survival probabilities for each groups.
Then the R function survminer::ggsurvplot()
with a survfit object will draw the two survival curves and
perform the log-rank test as shown in the following figure.
clin$age2 = clin$age
clin$age2[clin$age2 < 60] = 0
clin$age2[clin$age2 >= 60] = 1
survival::survdiff(Surv(time, status) ~ age2, data = clin)
sfit2 = survfit(Surv(time, status) ~ age2, data = clin)
ggsurv = ggsurvplot(sfit2, conf.int = TRUE, risk.table = TRUE,
xlab = "Time since diagnosis (year)", legend = c(.8,.9),
legend.labs = c("<60", ">=60"), legend.title = "Age",
risk.table.y.text.col = TRUE, risk.table.y.text = FALSE)
ggsurv$plot = ggsurv$plot +
annotate("text", x = 22, y = .72, label= paste0("Log-rank test:\n", surv_pvalue(sfit2)$pval.txt))
ggsurv
Kaplan-Meier curves of the BRCA patients’ survival data from TCGA grouped by age \(<60\) and \(\ge 60\). The log-rank test is to compare the two survival distributions corresponding to the two groups of patients.
To analyze if a continuous variable, e.g. age, is associated with the
survival outcomes, we can use the R function
coxph() for fitting a Cox model, which is similar to the
function lm() for fitting linear models.
fit_cox = coxph(Surv(time, status) ~ age, data = clin)
summary(fit_cox)Call:
coxph(formula = Surv(time, status) ~ age, data = clin)
n= 1047, number of events= 149
(14 observations deleted due to missingness)
coef exp(coef) se(coef) z Pr(>|z|)
age 0.034244 1.034837 0.006703 5.109 3.24e-07 ***
---
Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1
exp(coef) exp(-coef) lower .95 upper .95
age 1.035 0.9663 1.021 1.049
Concordance= 0.639 (se = 0.029 )
Likelihood ratio test= 26.34 on 1 df, p=3e-07
Wald test = 26.1 on 1 df, p=3e-07
Score (logrank) test = 26.63 on 1 df, p=2e-07The Cox model assumes proportional hazards and log-linearity of the covariates. To check the log-linearity for a clinical or demographic variable, e.g. age, we can fit a penalized smoothing spline for age effect. The following code shows that the nonlinear part of the smoothing spline does not have a significant effect (\(p = 0.00013\)). Thus, the assumption of log-linearity for age is not satisfied.
fit_cox_spline = coxph(Surv(time, status) ~ pspline(age), data = clin)
fit_cox_splineCall:
coxph(formula = Surv(time, status) ~ pspline(age), data = clin)
coef se(coef) se2 Chisq DF p
pspline(age), linear 0.03509 0.00577 0.00577 36.98323 1.00 1.2e-09
pspline(age), nonlin 20.69146 3.03 0.00013
Iterations: 5 outer, 15 Newton-Raphson
Theta= 0.828
Degrees of freedom for terms= 4
Likelihood ratio test=46.4 on 4.03 df, p=2e-09
n= 1047, number of events= 149
(14 observations deleted due to missingness)To check proportional hazards of age, we can add a time-dependent covariate \(age \times g(t)\), where \(g(t)\) is a known function e.g. \(g(t) = \log t\). The following code shows that the time-dependent age is significant using a score test (\(p = 0.0087\)). Thus, the assumption of proportional hazards for age is not satisfied. The above two tests indicate a non-loglinear or time-dependent association of age with the survival outcomes.
survival::cox.zph(fit_cox, transform = "log") chisq df p
age 6.88 1 0.0087
GLOBAL 6.88 1 0.0087Here the approaches for checking log-linearity or proportional hazards can only be used in low-dimensional data settings. When including high-dimensional omics data, there are no standard approaches for checking log-linearity or proportional hazards currently.
Feature preselection/filtering
From a practical point of view, since most omics profiles contain thousands of variables and most supervised statistical methods are not suited for high dimensional omics features, it is better to filter the omics features first. In addition, we perceive that not too many omics features are relevant to one medical problem. We will demonstrate two different filtering approaches for high-dimensional omics data:
- Univariate p-value-based filtering
- Univariate variance-based filtering
P-value filter
Before joint analyzing the associations between the thousands of omics features and survival outcomes, one can analyze the association between each omics feature and the survival outcomes, and filter omics features at a statistical significance level \(0.1\) or \(0.2\) (larger than 0.05 to reduce false negative identification of omics features in multivariate analysis). For demonstration, based on the \(100\) mRNA-Seq features from TCGA breast cancer patients preprocessed previously, the code below filters omics features at the statistical significance level \(0.2\), i.e. univariate analysis \(p < 0.2\).
RNA_log2count = log2(RNA_count[1:100, ] + 1)
pvalues <- rep(NA, nrow(RNA_log2count))
for(j in 1:nrow(RNA_log2count)) {
fit_cox = coxph(Surv(clin$time, clin$status) ~ RNA_log2count[j, ], data = clin)
pvalues[j] = summary(fit_cox)$coefficients[, "Pr(>|z|)"]
}
filtered_rna <- RNA_log2count[which(pvalues < 0.2), ]Variance filter
The other common and easy way to decrease the number of omics features is to filter the most variable ones for further analysis. Note that the variance-based filtering step should be done before data standardization (i.e. calculating \(z\)-score), but can be performed after count data normalization and log2-transformation for instance.
The R package M3C
(John et al. 2020) provides a filter
function featurefilter() by using different variance-type
metrics, for example, variance, median absolute deviation (MAD),
coefficient of variation (A) and its second order derivative (A2). The
simple variance filter can be used if the variance does not change with
the corresponding mean, otherwise the coefficient of variation can be
used. If the omics data include outliers, MAD filter is more robust than
the variance filter. Based on the \(60660\) mRNA-Seq features from TCGA breast
cancer patients preprocessed previously, the code below extracts the
\(1\%\) most variable features using
variance as a filtering metric.
RNA_log2count = log2(RNA_count + 1)
filtered = M3C::featurefilter(RNA_log2count, percentile = 1, method = 'var', topN = 5)
filtered_rna1 = filtered$filtered_data***feature filter function***
extracting the most variable: 1 percent
features to start with: 60660
performing calculations for variance
printing topN most variable features with statistics...
feature mean var sd
ENSG00000166509.12 ENSG00000166509.12 6.084336 31.60450 5.621788
ENSG00000110484.7 ENSG00000110484.7 11.004346 26.22686 5.121216
ENSG00000153002.12 ENSG00000153002.12 8.222386 25.87780 5.087022
ENSG00000134184.13 ENSG00000134184.13 5.371158 23.28756 4.825719
ENSG00000160182.3 ENSG00000160182.3 9.901567 21.48403 4.635087
features remaining: 607Another variance-type filter is to remain features with certain percentage of cumulative variances, which will usually filter fewer features than the approaches above. The code below extracts the most variable features explaining \(1\%\) cumulative variances.
cumsum_var = cumsum(filtered$statistics$var)
cumsum_cutoff = cumsum_var[length(cumsum_var)] * 0.01
filtered_names = filtered$statistics$feature[cumsum_var < cumsum_cutoff]Multivariate analysis
Unsupervised learning (omics data)
In this section we will use the mRNA-Seq data of breast cancer patients from TCGA. The following unsupervised methods can be applied to other omics data as well (the same applies to the supervised learning methods). One important thing is that the input omics data, especially the data type and dimensions, should be suited to the methods.
Unsupervised learning for omics data can be helpful to explore
subpopulations of the data, for example, patients from one cancer type
can be divided to several omics-related subtypes. We demonstrate three
unsupervised learning methods, i.e. principal component analysis (PCA),
\(t\)-stochastic neighbour embedding
(\(t\)-SNE) and uniform manifold
approximation and projection (UMAP), based on the PAM50 genes (Parker
et al. 2009). The R package M3C
(John et al. 2020) provides the analyses
and visualization of all the three methods.
# extract the PAM50 genes of TCGA-BRCA patients
TCGA_PAM50 = RNA_count[sapply(strsplit(rownames(RNA_count), ".", fixed = TRUE), function(x) x[[1]]) %in% c(
"ENSG00000077152", "ENSG00000089685", "ENSG00000143228", "ENSG00000094804", "ENSG00000134057",
"ENSG00000176890", "ENSG00000101057", "ENSG00000138180", "ENSG00000165304", "ENSG00000080986",
"ENSG00000171848", "ENSG00000175063", "ENSG00000117724", "ENSG00000164611", "ENSG00000174371",
"ENSG00000091651", "ENSG00000011426", "ENSG00000105173", "ENSG00000117399", "ENSG00000148773",
"ENSG00000142945", "ENSG00000133627", "ENSG00000136997", "ENSG00000146648", "ENSG00000186081",
"ENSG00000092621", "ENSG00000062038", "ENSG00000261857", "ENSG00000128422", "ENSG00000054598",
"ENSG00000104332", "ENSG00000186847", "ENSG00000091831", "ENSG00000141424", "ENSG00000107262",
"ENSG00000186868", "ENSG00000082175", "ENSG00000171604", "ENSG00000115648", "ENSG00000171791",
"ENSG00000135679", "ENSG00000171428", "ENSG00000129514", "ENSG00000106605", "ENSG00000099953",
"ENSG00000173890", "ENSG00000160867", "ENSG00000141738", "ENSG00000151715", "ENSG00000141736"), ]
# use gene symbols instead of Ensembl IDs
rownames(TCGA_PAM50) =
c("UBE2T", "BIRC5", "NUF2", "CDC6", "CCNB1", "TYMS", "MYBL2", "CEP55", "MELK", "NDC80", "RRM2",
"UBE2C", "CENPF", "PTTG1", "EXO1", "ORC6L", "ANLN", "CCNE1", "CDC20", "MKI67", "KIF2C",
"ACTR3B", "MYC", "EGFR", "KRT5", "PHGDH", "CDH3", "MIA", "KRT17", "FOXC1", "SFRP1", "KRT14",
"ESR1", "SLC39A6", "BAG1", "MAPT", "PGR", "CXXC5", "MLPH", "BCL2", "MDM2", "NAT1", "FOXA1",
"BLVRA", "MMP11", "GPR160", "FGFR4", "GRB7", "TMEM45B", "ERBB2")
# log2-transformation of the normalized count data
TCGA_PAM50 = log2(TCGA_PAM50 + 1)
pam50 = factor(clin$paper_BRCA_Subtype_PAM50)
M3C::pca(TCGA_PAM50, labels = pam50, dotsize = 3, legendtitle = "Subtype")
Unsupervised clustering (principal component analysis, PCA) of transcriptomic data from TCGA breast cancer patients
M3C::tsne(TCGA_PAM50, labels = pam50, dotsize = 3, legendtitle = "Subtype")
Unsupervised clustering (\(t\)-stochastic neighbour embedding, \(t\)-SNE) of transcriptomic data from TCGA breast cancer patients
M3C::umap(TCGA_PAM50, labels = pam50, dotsize = 3, legendtitle = "Subtype")
Unsupervised clustering (uniform manifold approximation and projection, UMAP) of transcriptomic data from TCGA breast cancer patients
Supervised learning (omics and survival data)
To investigate the relationship between omics features and survival outcomes, regression methods (i.e. supervised learning) can be applied. Since omics data are high-dimensional, one can use unsupervised learning methods to summarize a few components (dimension reduction) and regress the survival outcomes on the low-dimensional components by some classical statistical methods, e.g. classical Cox model. There are also frequentist and Bayesian supervised learning methods suited to directly regress the survival outcomes on the high-dimensional omics features. Note that preselecting/filtering ultrahigh-dimensional omics features can be useful before running the frequentist and Bayesian supervised learning methods.
Dimension reduction for Cox models
The following code demonstrates the use of the first two principal components of PCA as covariates for the purpose of survival prediction. Similarly, the first components from \(t\)-SNE or UMAP can also be extracted as covariates.
# principal component regression
x_tmp = prcomp(t(TCGA_PAM50))
# choose the top two components (subjective) as covariates
X_PC = x_tmp$x[, 1:2]
# build classical survival model (e.g. PH Cox model)
data_tmp = data.frame(time = clin$time, status = clin$status, X_PC)
fit = coxph(Surv(time, status) ~ PC1 + PC2, data = data_tmp)
summary(fit)Call:
coxph(formula = Surv(time, status) ~ PC1 + PC2, data = data_tmp)
n= 1047, number of events= 149
coef exp(coef) se(coef) z Pr(>|z|)
PC1 0.004894 1.004906 0.009689 0.505 0.61348
PC2 0.038269 1.039010 0.013224 2.894 0.00381 **
---
Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1
exp(coef) exp(-coef) lower .95 upper .95
PC1 1.005 0.9951 0.986 1.024
PC2 1.039 0.9625 1.012 1.066
Concordance= 0.58 (se = 0.028 )
Likelihood ratio test= 8.62 on 2 df, p=0.01
Wald test = 8.71 on 2 df, p=0.01
Score (logrank) test = 8.73 on 2 df, p=0.01Penalized Cox models
For computational efficiency, we will use only the mRNA-Seq features corresponding to the PAM50 genes (Parker et al. 2009) instead of the variance filtered genes from the previous section. We perform an investigation of the relationships between the mRNA-Seq features, two clinical variables (i.e. the patients’ age at diagnosis and their ethnicity) and the survival outcomes.
The R package glmnet
(Friedman, Hastie, and Tibshirani 2010)
is very computationally efficient to run Lasso and Elastic Net Cox
models. Lasso has a tuning parameter \(\lambda\) to control the penalty strength
of the coefficients which can be optimized by cross-validation (CV) via
function cv.glmnet(). The glmnet() and
cv.glmnet() functions provide the argument
penalty.factor to allow different shrinkages for different
features, which makes sense if one includes both clinical/demographic
variables and omics features and does not want to perform feature
selection for the clinical/demographic variables.
## Lasso Cox model
## for demonstration simplicity, PAM50 genes are used here
x = cbind(age = clin$age, ethnicity = factor(clin$ethnicity), t(TCGA_PAM50))
y = cbind(time = clin$time, status = clin$status)
# set penalty factor without penalizing the two demographical variables
pf = c(rep(0, 2), rep(1, ncol(x) - 2))
# Lasso Cox by using cv.glmnet to obtain the 5-fold CV optimal lambda.min or lambda.1se
set.seed(123)
cvfit = glmnet::cv.glmnet(x, y, family = "cox", nfolds = 5, penalty.factor = pf)
mod = cvfit$glmnet.fit
lambda_optimal = cvfit$lambda.min # optimal lambda
betas = as.vector(coef(mod, s = lambda_optimal))
beta.positive = colnames(x)[betas > 0]
beta.negative = colnames(x)[betas < 0]
#get ordered list of variables as they appear at smallest lambda
allnames = names(coef(mod)[, ncol(coef(mod))]
[order(coef(mod)[, ncol(coef(mod))], decreasing = TRUE)])
# assign colors
cols = rep("gray80", length(allnames))
cols[allnames %in% beta.positive] = "seagreen3"
cols[allnames %in% beta.negative] = "hotpink"
# drwa coefficient paths of a Lasso Cox model
plotmo::plot_glmnet(mod, label = TRUE, s = lambda_optimal, col = cols,
xlab = expression(log ~~ lambda), ylab = expression(beta))
title("Lasso \n\n")
Coefficient paths of a Lasso Cox model. The verticle gray line indicates the optimal \(\lambda\) and its correspondingly selected features are marked as green (positive coefficient) and red (negative coefficient) colors. Note that the demographic variables age and ethnicity were not penalized, so that their coefficient paths did not start from zero in the figure.
Elastic Net Cox model includes the \(\lambda\) and an additional penalty parameter \(\alpha \in [0,1]\). The parameter \(\alpha\) can be fixed as \(0\) (Ridge), \(1\) (Lasso) or any value between \(0\) and \(1\) for making a compromise between Ridge and Lasso, which can also be optimized by cross-validation manually, see the example below.
## Elastic Net Cox model
# set penalty parameter alpha which comprises between Lasso and ridge regressions
alpha = seq(0.1, 1, length = 10)
fitEN = list()
set.seed(123)
for(i in 1:length(alpha)) {
fitEN[[i]] = cv.glmnet(x, y, family = "cox", alpha = alpha[i], nfolds = 5, penalty.factor = pf)
}
idx = which.min(sapply(fitEN, function(xx) {xx$cvm[xx$lambda == xx$lambda.min]}))
cvfit = fitEN[[idx]]
# the following code is the same as Lasso previously
mod = cvfit$glmnet.fit
lambda_optimal = cvfit$lambda.min # optimal lambda
betas = as.vector(coef(mod, s = lambda_optimal))
beta.positive = colnames(x)[betas > 0]
beta.negative = colnames(x)[betas < 0]
allnames = names(coef(mod)[, ncol(coef(mod))]
[order(coef(mod)[, ncol(coef(mod))], decreasing = TRUE)])
cols = rep("gray80", length(allnames))
cols[allnames %in% beta.positive] = "seagreen3"
cols[allnames %in% beta.negative] = "hotpink"
plotmo::plot_glmnet(mod, label = TRUE, s = lambda_optimal, col = cols,
xlab = expression(log ~~ lambda), ylab = expression(beta))
title("Elastic Net \n\n")
Coefficient paths of an Elastic Net Cox model. The verticle gray line indicates the optimal \(\lambda\) and its correspondingly selected features are marked as green (positive coefficient) and red (negative coefficient) colors. Note that the demographic variables age and ethnicity were not penalized, so that their coefficient paths did not start from zero in the figure.
Adaptive Lasso Cox model needs to pre-estimate all coefficients which
will be used as weights via the argument penalty.factor in
the glmnet() and cv.glmnet() functions to fit
a Lasso Cox model. The pre-estimation can be done by a Ridge Cox model,
see an example below.
## Adaptive Lasso Cox model
set.seed(123)
fit = cv.glmnet(x, y, family = "cox", alpha = 0, nfolds = 5)
weights = abs(1 / as.vector(coef(fit, s = "lambda.min")))
# adaptive Lasso Cox by using cv.glmnet to obtain the 5-fold CV optimal lambda.min or lambda.1se
cvfit = cv.glmnet(x, y, family = "cox", nfolds = 5, penalty.factor = pf)
mod = cvfit$glmnet.fit
lambda_optimal = cvfit$lambda.min # optimal lambda
betas = as.vector(coef(mod, s = lambda_optimal))
beta.positive = colnames(x)[betas > 0]
beta.negative = colnames(x)[betas < 0]
#get ordered list of variables as they appear at smallest lambda
allnames = names(coef(mod)[, ncol(coef(mod))]
[order(coef(mod)[, ncol(coef(mod))], decreasing = TRUE)])
#assign colors
cols = rep("gray80", length(allnames))
cols[allnames %in% beta.positive] = "seagreen3"
cols[allnames %in% beta.negative] = "hotpink"
plot_glmnet(mod, label = TRUE, s = lambda_optimal, col = cols,
xlab = expression(log ~ lambda), ylab = expression(beta))
title("Adative Lasso \n\n")
Coefficient paths of an adaptive Lasso Cox model. The verticle gray line indicates the optimal \(\lambda\) and its correspondingly selected features are marked as green (positive coefficient) and red (negative coefficient) colors. Note that the demographic variables age and ethnicity were not penalized, so that their coefficient paths did not start from zero in the figure.
Group Lasso Cox model can be implemented through the R
package grpreg
(Breheny and Huang 2015). For an
illustration, we specify the two demographic variables as the first
group, the first \(10\) PAM50 genes as
the second group, the last \(40\) PAM50
genes as the third group. A \(k\)-fold
cross-validation (CV) for the group Lasso Cox model is performed through
function cv.grpsurv(). The returned object
cvfit$lambda.min is the value of CV-optimized \(\lambda\). The following results show
that
- when choosing the CV-optimized \(\lambda = 0.0143\) (output matrix has lambda values as column names), the estimated coefficients of the first two groups are nonzero (i.e. selecting first and second groups);
- when choosing the \(10\)-th lambda \(\lambda = 0.0217\), only the first group of covariates has nonzero coefficients (i.e. selecting first group);
- when choosing the \(15\)-th lambda \(\lambda = 0.0108\), the estimated coefficients of all the three groups are nonzero (i.e. selecting all groups).
Note that the R package grpreg
(Breheny and Huang 2015) also implements
group smoothly clipped absolute deviation (SCAD) model and some others,
see Breheny, Zeng, and Kurth (2021) for
details.
# group Lasso Cox model
group = c(rep("demographic", 2), rep("PAM50_1", 10), rep("PAM50_2", 40))
group = factor(group)
set.seed(123)
cvfit = grpreg::cv.grpsurv(X = x, y = y, group = group, penalty = "grLasso", returnY = TRUE)
round(cvfit$fit$beta[, c(which.min(cvfit$cve), 10, 20)], digits = 4) 0.0143 0.0217 0.0108
age 0.0219 0.0154 0.0247
ethnicity -0.0542 -0.0425 -0.0569
UBE2T 0.0209 0.0000 0.0732
BIRC5 -0.0035 0.0000 -0.0109
NUF2 -0.0031 0.0000 -0.0093
CDC6 0.0155 0.0000 0.0546
CCNB1 -0.0247 0.0000 -0.0846
TYMS -0.0028 0.0000 -0.0086
MYBL2 -0.0147 0.0000 -0.0522
CEP55 0.0152 0.0000 0.0507
MELK -0.0001 0.0000 -0.0006
NDC80 0.0007 0.0000 0.0022
RRM2 0.0000 0.0000 -0.0100
UBE2C 0.0000 0.0000 0.0076
CENPF 0.0000 0.0000 -0.0002
PTTG1 0.0000 0.0000 0.0052
EXO1 0.0000 0.0000 -0.0002
ORC6L 0.0000 0.0000 -0.0464
ANLN 0.0000 0.0000 -0.0175
CCNE1 0.0000 0.0000 -0.0155
CDC20 0.0000 0.0000 -0.0142
MKI67 0.0000 0.0000 -0.0245
KIF2C 0.0000 0.0000 -0.0123
ACTR3B 0.0000 0.0000 0.0043
MYC 0.0000 0.0000 -0.0137
EGFR 0.0000 0.0000 0.0319
KRT5 0.0000 0.0000 -0.0059
PHGDH 0.0000 0.0000 0.0004
CDH3 0.0000 0.0000 -0.0265
MIA 0.0000 0.0000 0.0049
KRT17 0.0000 0.0000 -0.0088
FOXC1 0.0000 0.0000 0.0096
SFRP1 0.0000 0.0000 0.0235
KRT14 0.0000 0.0000 0.0218
ESR1 0.0000 0.0000 -0.0158
SLC39A6 0.0000 0.0000 0.0284
BAG1 0.0000 0.0000 0.0104
MAPT 0.0000 0.0000 0.0023
PGR 0.0000 0.0000 0.0095
CXXC5 0.0000 0.0000 -0.0182
MLPH 0.0000 0.0000 -0.0059
BCL2 0.0000 0.0000 0.0133
MDM2 0.0000 0.0000 -0.0084
NAT1 0.0000 0.0000 -0.0008
FOXA1 0.0000 0.0000 -0.0055
BLVRA 0.0000 0.0000 0.0053
MMP11 0.0000 0.0000 -0.0037
GPR160 0.0000 0.0000 -0.0328
FGFR4 0.0000 0.0000 -0.0029
GRB7 0.0000 0.0000 0.0086
TMEM45B 0.0000 0.0000 -0.0078
ERBB2 0.0000 0.0000 -0.0194Sparse group Lasso Cox model is implemented in the R
package SGL
(N.
Simon et al. 2019). The function cvSGL() uses
cross validation to optimize the penalty parameter \(\lambda\). The following example shows that
it induces sparsity in each group of covariates.
# sparse group Lasso Cox model
group = c(rep("demographic", 2), rep("PAM50_1", 10), rep("PAM50_2", 40))
group = factor(group)
dat_tmp = list(x = x, time = clin$time, status = clin$status)
set.seed(123)
cvfit = SGL::cvSGL(dat_tmp, index = group, type = "cox", nfold = 5)
beta.hat = cvfit$fit$beta[, which.min(cvfit$lldiff)]
names(beta.hat) = paste0("group", as.numeric(group), ".", c(1:2, 1:10, 1:40))
beta.hat group1.1 group1.2 group2.1 group2.2 group2.3 group2.4
5.68387570 0.00000000 0.50711740 0.00000000 0.00000000 0.21522490
group2.5 group2.6 group2.7 group2.8 group2.9 group2.10
0.00000000 0.00000000 0.00000000 0.34168669 0.00000000 0.00000000
group3.1 group3.2 group3.3 group3.4 group3.5 group3.6
0.00000000 0.25691478 0.00000000 -0.37494726 0.00000000 -2.85110146
group3.7 group3.8 group3.9 group3.10 group3.11 group3.12
-1.93556994 0.00000000 0.00000000 0.00000000 -1.77805542 0.00000000
group3.13 group3.14 group3.15 group3.16 group3.17 group3.18
0.00000000 1.03819778 0.00000000 0.00000000 0.00000000 0.00000000
group3.19 group3.20 group3.21 group3.22 group3.23 group3.24
0.00000000 0.00000000 0.00000000 0.00000000 -0.34496717 0.00000000
group3.25 group3.26 group3.27 group3.28 group3.29 group3.30
1.01552095 0.00000000 0.00000000 0.00000000 0.00000000 0.00000000
group3.31 group3.32 group3.33 group3.34 group3.35 group3.36
-2.13205587 0.00000000 0.00000000 0.00000000 0.00000000 -0.95048121
group3.37 group3.38 group3.39 group3.40
-1.86222105 -0.01120573 -0.81157646 -2.14148900 Sparse Bayesian Cox models
The R package psbcGroup
(Lee,
Chakraborty, and Sun 2021) integrates a large set of sparse
Bayesian Cox models. The function psbcGL() implements
Bayesian Cox models with Lasso and group Lasso priors for feature
selection and group selection respectively. For the Lasso prior, set the
hyperparameter priorPara$groupInd = 1:p where \(p\) is the total number of covariates. For
the group Lasso prior, set the hyperparameter
priorPara$groupInd as a vector of size \(p\), where each element denotes which group
each covariate corresponds to. Note that psbcGroup
cannot distinguish mandatory (unpenalized) covariates with omics
features, see Zucknick, Saadati, and Benner (2015) for an
extended Bayesian Lasso Cox model.
# Bayesian Cox model with Lasso prior
set.seed(123)
survObj = list(t = clin$time, di = clin$status, x = x)
p = ncol(x)
# set hyperparameters.
# For Lasso prior (i.e. 'groupInd'= 1:p), larger ratio r/delta tends to force the posterior betas to be more concentrated at 0
# For group Lasso prior (i.e. 'groupInd' as group indicator for covariates), larger ratio r/delta tends to force stronger grouping effect of covariates
s = c(sort(survObj$t[survObj$di == 1]), 2 * max(survObj$t) - max(survObj$t[-which(survObj$t==max(survObj$t))]))
priorPara = list('eta0' = 1, 'kappa0' = 1, 'c0'= 2, 'r' = 0.5,
'delta' = 0.0001, 's'= s, 'J'=length(s), 'groupInd'= 1:p)
# set MCMC parameters
mcmcPara = list('numBeta'= p, 'beta.prop.var'= 1)
# set initial values of hyperparameters
lambdaSq = 1
initial = list('beta.ini'= rep(0, p), 'lambdaSq' = 1, 'sigmaSq' = runif(1, 0.1, 10),
'tauSq' = rexp(length(unique(priorPara$groupInd)), 'rate' = lambdaSq / 2),
'h' = rgamma(priorPara$J, 1, 1))
# in real applications, 'num.reps' should be large enough (e.g. 20000, 40000) and 'chain' to be > 1
BayesLassofit = psbcGroup::psbcGL(survObj, priorPara, initial, rw = TRUE, mcmcPara, num.reps = 100, thin = 1, chain = 1)
# burn-in the first half MCMC iterations
beta_p = BayesLassofit$beta.p[-(1:51), ]
beta_mean = colMeans(beta_p)
beta_L = apply(beta_p, 2, quantile, 0.025)
beta_U = apply(beta_p, 2, quantile, 0.975)
tbl = data.frame(term = colnames(x), estimate = beta_mean, conf.low = beta_L, conf.high = beta_U)
tbl$term = factor(tbl$term, levels = tbl$term)
GGally::ggcoef(tbl) + coord_flip() + xlab(expression(Posterior~~beta)) +
ylab("") + theme(axis.text.x = element_text(angle = 90, size = 7))
Estimates of regression coefficients by a penalized semiparametric Bayesian Cox model with Lasso prior. Solid dots indicate the posterior mean over MCMC iterations (excluding burn-in period), and verticle lines show the corresponding 95% credibility intervals.
In the R package psbcGroup
(Lee,
Chakraborty, and Sun 2021), function psbcEN()
implements Bayesian Cox models with Elastic Net prior for feature
selection with grouping effect of correlated features. Function
psbcFL() implements Bayesian Cox models with fused Lasso
prior.
# Bayesian Cox model with Elastic Net prior
set.seed(123)
# set hyperparameters
# Larger ratio r1/delta1 forces the posterior betas to be more concentrated at 0
# Larger ratio r2/delta2 forces stronger grouping effect of covariates
priorPara = list('eta0' = 1, 'kappa0' = 1, 'c0'= 2, 'r1' = 0.1, 'r2' = 1,
'delta1' = 0.1, 'delta2' = 1, 's'= s, 'J' = length(s))
# set MCMC parameters
mcmcPara = list('numBeta'= p, 'beta.prop.var'= 1)
# set initial values of hyperparameters
initial = list('beta.ini'= rep(0, p), 'lambda1Sq' = 1, 'lambda2' = 1, 'sigmaSq' = runif(1, 0.1, 10),
'tauSq' = rexp(p, rate = 1 / 2), 'h' = rgamma(priorPara$J, 1, 1))
# in real application, 'num.reps' should be large enough (e.g. 20000, 40000) and 'chain' to be > 1
BayesENfit = psbcEN(survObj, priorPara, initial, rw = TRUE, mcmcPara, num.reps = 100, thin = 1, chain = 1)
# burn-in the first half MCMC iterations
EN_beta_p = BayesENfit$beta.p[52:101, ]
EN_beta_mean = colMeans(EN_beta_p)
EN_beta_L = apply(EN_beta_p, 2, quantile, 0.025)
EN_beta_U = apply(EN_beta_p, 2, quantile, 0.975)
EN_tbl = data.frame(term = colnames(x), estimate = EN_beta_mean, conf.low = EN_beta_L, conf.high = EN_beta_U)
EN_tbl$term = factor(EN_tbl$term, levels = EN_tbl$term)
ggcoef(EN_tbl) + coord_flip() + xlab(expression(Posterior~~beta)) +
ylab("") + theme(axis.text.x = element_text(angle = 90, size = 7))
Estimates of regression coefficients by a penalized semiparametric Bayesian Cox model with Elastic Net prior. Solid dots indicate the posterior mean over MCMC iterations (excluding burn-in period), and verticle lines show the corresponding 95% credibility intervals.
A penalized semiparametric Bayesian Cox model with double exponential
spike-and-slab prior is implemented in the R package BhGLM
(Yi et
al. 2019). Note that BhGLM provides
frequentist confidence intervals of the posterior mode of the
coefficients.
# penalized semiparametric Bayesian Cox model with (double exponential) spike-and-slab prior
y_surv = Surv(clin$time, clin$status)
x_dataframe = as.data.frame(x)
set.seed(123)
Bayesfit = BhGLM::bcoxph(y_surv ~ ., x_dataframe, prior = mde(0, 0.01, 0.8), control = coxph.control(iter.max = 200))
BhGLM::plot.bh(Bayesfit, col.pts = c("red", "blue"), main = "Cox with mixture double exponential\n") 
Coefficient estimates of a penalized semiparametric Bayesian Cox model with (double exponential) spike-and-slab prior. Solid dots denote the posterior mode of the coefficients and lines denote the 95% confidence intervals. Red colored text on the right side mark the significant features with \(p < 0.05\).
Survival model validation
The ideal evaluation of a prognostic model is based on completely independent validation data. If there are no independent validation data, it is recommended to use resampling-based methods for estimating the uncertainty of the model’s prediction performance. This can be done for example by repeatedly splitting the dataset to training/validation sets and evaluating a model’s performance on the different validation sets using various evaluation metrics.
To evaluate a prognostic model, there exist several performance metrics. These can be time-dependent or time-independent, with the time-dependent metrics being more informative in general compared to integrated measures (i.e. evaluated across many time points). For survival data, we can assess the discriminatory power of a model (i.e. how well does it ranks patients) or how well a model is calibrated (i.e. how closely the predicted survival probabilities agree numerically with the actual survival outcomes). For example, measures such as the (integrated) area under time-specific ROC curves (AUC, Heagerty and Zheng (2005)) and the concordance index (C-index, Harrell et al. (1982)) are measures of discrimination, while the right-censored logarithmic loss (RCLL, Avati et al. (2020)) is a measure of calibration. The well-known Brier score (Graf et al. 1999) is used to evaluate both discrimination and calibration performance.
For one split of train/validation data sets, one can estimate a survival discrimation or calibration metric based on either the training or validation data set, such as AUC, C-index and Brier score and their corresponding time-dependent metrics, see the table below. Since high-dimensional survival models built on the training data can be overfitted, the conclusion should be drawn based on the evaluation from the validation data.
Training data Validation data
|------------------------------:|------------------------------:|
| Time-dependent | Integrated | Time-dependent | Integrated |
|-----------------|:-----------:|-----------------|:-----------:|
AUC | ✓ | ✓ | ✓ | ✓ |
C-index | ✓ | ✓ | ✓ | ✓ |
Brier score | ✓ | ✓ | ✓ | ✓ |Model evaluation (classic)
‘Classic’ here refers to the use of manual R code in
combination with many separate R packages which have been
routinely used in academia the latest 10+ years for evaluating survival
models.
To evaluate the performance of a statistical model, we first split the data into training and validation data sets. For example, we can randomly split the 1047 BRCA patients from TCGA into \(80\%\) as training set and \(20\%\) as validation set.
set.seed(123)
n = nrow(x)
idx = sample(1:n, n * 0.8, replace = FALSE)
x_train = x[idx, ]
y_train = y[idx, ]
x_validate = x[-idx, ]
y_validate = y[-idx, ]The \(20\%\) split of a dataset is often not considered an independent dataset and resampling-based methods should be used in such cases to provide an unbiased estimate of the predictive accuracy of a prognostic model.
Discrimination metrics
Goodness-of-fit
The simplest way to demonstrate the prognostic power of a survival model is to dichotomize the prognostic scores (i.e., linear predictor \(lp\) in the Cox model) by median value, and then to use a log-rank test to compare the survival curves of the patients in the two groups. We use the built model to predict the prognostic scores based on the \(20\%\) validation data. The following code shows the goodness-of-fit of a Lasso Cox model with the BRCA patients survival and PAM50 mRNA-Seq data from TCGA.
# train a Lasso Cox model, similarly for other Cox-type models
set.seed(123)
cvfit = cv.glmnet(x_train, y_train, family = "cox", nfolds = 5, penalty.factor = pf)
pred_lp = predict(cvfit, newx = x_validate, s = cvfit$lambda.min, type = "link")
# dichotomize by prognostic scores (linear predictor) by median to divide the validation patients into two groups
group_dichotomize = as.numeric(pred_lp > median(pred_lp))
# draw two survival curves based on KM estimation and compare them by a log-rank test
dat_tmp = data.frame(time = y_validate[, 1], status = y_validate[, 2], group = group_dichotomize)
sfit = survfit(Surv(time, status) ~ group, data = dat_tmp)
ggsurv = ggsurvplot(sfit, conf.int = TRUE, risk.table = TRUE,
xlab = "Time since diagnosis (year)", legend = c(.2,.3),
legend.labs = c("Low risk", "High risk"), legend.title = "Dichotomized groups",
risk.table.y.text.col = TRUE, risk.table.y.text = FALSE)
ggsurv$plot = ggsurv$plot +
annotate("text", x = 2.6, y = .03, label= paste0("Log-rank test:\n", surv_pvalue(sfit)$pval.txt))
ggsurv$table = ggsurv$table + labs(y = "Dichotomized\n groups")
ggsurv
Kaplan-Meier curves of the BRCA patients data dichotomized by the median of prognostic scores (calculated from the Lasso Cox model with patients’ survival and mRNA-Seq data) into two groups. The log-rank test is to compare the two survival distributions corresponding to the two groups of patients.
The prognostic scores can also be divided into three or more groups based on quantiles and the log-rank test can be used to compare the difference of multiple survival curves.
group = pred_lp
group[pred_lp >= quantile(pred_lp, 2/3)] = 3
group[pred_lp >= quantile(pred_lp, 1/3) & pred_lp < quantile(pred_lp, 2/3)] = 2
group[pred_lp < quantile(pred_lp, 1/3)] = 1
# draw two survival curves based on KM estimation and compare them by a log-rank test
dat_tmp = data.frame(time = y_validate[, 1], status = y_validate[, 2], group = group)
sfit = survfit(Surv(time, status) ~ group, data = dat_tmp)
ggsurv = ggsurvplot(sfit, conf.int = TRUE, risk.table = TRUE,
xlab = "Time since diagnosis (year)", legend = c(.2,.3),
legend.labs = c("Low risk", "Middle risk", "High risk"), legend.title = "Groups",
risk.table.y.text.col = TRUE, risk.table.y.text = FALSE)
ggsurv$plot = ggsurv$plot +
annotate("text", x = 3.5, y = .05, label= paste0("Log-rank test:\n", surv_pvalue(sfit)$pval.txt))
ggsurv
Kaplan-Meier curves of the BRCA patients data divided by 33% and 67% quantiles of prognostic scores (calculated from the Lasso Cox model with patients’ survival and mRNA-Seq data) into three groups. The log-rank test is to compare the two survival distributions corresponding to the three groups of patients.
Time-dependent AUC
The R package risksetROC
(Heagerty and Zheng 2005) can estimate
both time-dependent and integrated AUC. We demonstrate the calculation
based on both training and validation data.
A Cox proportional hazards model (and Lasso Cox as a consequence) is
a semi-parametric model, which means that it does not produce survival
distribution predictions by default. However, using the function
risksetROC::CoxWeights() you can transform the
cv.glmnet’s output linear predictors (lp) to
survival distribution predictions. This transformation internally uses
the Breslow estimator for the cumulative baseline hazard.
# unique event times for patients in the training and validation data sets
utimes_train = sort(unique(y_train[y_train[, 2] == 1, 1]))
utimes_validate = sort(unique(y_validate[y_validate[, 2] == 1, 1]))
# markers from the estimated linear predictors of a Lasso Cox model
pred_lp_train = predict(cvfit, newx = x_train, s = cvfit$lambda.min, type = "link")
pred_lp_validate = predict(cvfit, newx = x_validate, s = cvfit$lambda.min, type = "link")
## compute time-dependent AUC
AUC_train = rep(NA, length(utimes_train))
AUC_validate = rep(NA, length(utimes_validate))
for (j in 1:length(utimes_train)) {
out = risksetROC::CoxWeights(marker = pred_lp_train, Stime = y_train[, 1],
status = y_train[, 2], predict.time = utimes_train[j])
AUC_train[j] = out$AUC
}
for (j in 1:length(utimes_validate)) {
out = risksetROC::CoxWeights(marker = pred_lp_validate, Stime = y_validate[, 1],
status = y_validate[, 2], predict.time = utimes_validate[j])
AUC_validate[j] = out$AUC
}
# draw the time-dependent AUC from the training and validation data sets
dat_AUC = data.frame(tAUC = c(AUC_train, AUC_validate),
times = c(utimes_train, utimes_validate),
group = c(rep("AUC_train", length(AUC_train)), rep("AUC_validate", length(AUC_validate))))
ggplot(dat_AUC, aes(times, tAUC, group = group, color = group)) + xlab("Evaluation time points (year)") + ylab("AUC") + ylim(0.5, 1) +
geom_step(direction = "vh") + theme(legend.position = c(0.7, 0.8), legend.title=element_blank())
Time-dependent AUC based on a Lasso Cox model applied to the BRCA patients data from TCGA. The red line shows the Time-dependent AUC calculated from the 80% training data, and the green line shows the Time-dependent AUC calculated from the 20% validation data.
Integrated AUC
The R package risksetROC
(Heagerty and Zheng 2005) provides
function IntegrateAUC() to estimate integrated AUC.
# Before computing integrated AUC, first estimate survival probabilities at unique survival times
surv_prob_train = unique(survfit(Surv(y_train[, 1], y_train[, 2]) ~ 1)$surv)
surv_prob_validate = unique(survfit(Surv(y_validate[, 1], y_validate[, 2]) ~ 1)$surv)
## integrated AUC (e.g. over tmax=10 years) to get concordance measure based on training data
(iAUC_train = risksetROC::IntegrateAUC(AUC_train, utimes_train, surv_prob_train, tmax = 10))[1] 0.6281301## integrated AUC (e.g. over tmax=10 years) to get concordance measure based on validation data
(iAUC_validate = risksetROC::IntegrateAUC( AUC_validate, utimes_validate, surv_prob_validate, tmax = 10))[1] 0.6318857Time-dependent C-index
The C-index is not proper for \(t\)-year predictions, see Blanche, Kattan, and Gerds (2019). Consider using time-dependent AUC or time-dependent Brier score instead. For a time-dependent discrimination index for survival data, see Antolini et al. (2005).
C-index
The R package glmnet
provides the function glmnet::Cindex() to estimate
Harrell’s C-index from a “coxnet” object. The R package survAUC
provides the function survAUC::UnoC() to estimated Uno’s
C-index. See an example calculation for both C-indexes using a Lasso Cox
model below.
set.seed(123)
cvfit = cv.glmnet(x_train, y_train, family = "cox", nfolds = 5, penalty.factor = pf)
pred = predict(cvfit, newx = x_validate, type = "response", s = cvfit$lambda.min)
# Harrell's C-index
(Cindex_Harrell = mean(apply(pred, 2, Cindex, y = y_validate)))[1] 0.7320221# Uno's C-index
(Cindex_Uno = survAUC::UnoC(y_train, y_validate, pred))[1] 0.5786861Calibration metrics
Time-dependent Brier score
The R package riskRegression
can assess the prediction error curves of survival models based on the
time-dependent Brier score. Similar to the time-dependent AUC, one needs
to first calculate the linear predictors (\(lp\)) from a frequentist or Bayesian Cox
model, and then use survival::coxph() to regress the
survival outcomes on the linear predictor, which is prepared as input of
riskRegression::Score() to estimate the (time-dependent)
Brier score.
## time-dependent Brier score
# use the (x_train, y_train) 80% samples for training
# and the (x_validate, y_validate) 20% samples for testing
y_train_surv = Surv(y_train[,"time"], y_train[,"status"])
y_validate_surv = Surv(y_validate[,"time"], y_validate[,"status"])
set.seed(123)
cvfit = cv.glmnet(x_train, y_train_surv, family = "cox", nfolds = 5, penalty.factor = pf)
lp_train = predict(cvfit, newx = x_train, s = cvfit$lambda.min, type = "link")
lp_validate = predict(cvfit, newx = x_validate, s = cvfit$lambda.min, type = "link")
# prepare data format suited for function Score() from the riskRegression package
data_train = data.frame(time = y_train[,"time"], status = y_train[,"status"], lp = as.vector(lp_train))
data_validate = data.frame(time = y_validate[,"time"], status = y_validate[,"status"], lp = as.vector(lp_validate))
lasso_train = coxph(Surv(time,status) ~ lp, data = data_train, y=TRUE, x = TRUE)
lasso_validate = coxph(Surv(time,status) ~ lp, data = data_validate, y=TRUE, x = TRUE)
# calculate Brier scores based on both training and validation data
Brier_train = riskRegression::Score(list("Brier_train" = lasso_train), formula = Surv(time, status) ~ 1, data = data_train, conf.int = FALSE, metrics = "brier", summary="ibs", times = sort(unique(data_train$time)))$Brier$score
Brier_validate = riskRegression::Score(list("Brier_validate" = lasso_validate), formula = Surv(time, status) ~ 1, data = data_validate, conf.int = FALSE, metrics = "brier", summary="ibs", times = sort(unique(data_validate$time)))$Brier$score
Brier_score = rbind(Brier_train, Brier_validate)
Brier_score = Brier_score[Brier_score$model != "Null model", ]
ggplot(Brier_score, aes(times, Brier, group = model, color = model)) + xlab("Evaluation time points (year)") + ylab("Brier score") +
geom_step(direction = "vh") + theme(legend.position = c(0.15, 0.88), legend.title=element_blank())
Time-dependent Brier score based on a Lasso Cox model applied to the BRCA patients data from TCGA. The red line shows the Time-dependent Brier score calculated from the 80% training data, and the green line shows the Time-dependent Brier score calculated from the 20% validation data.
Integrated Brier score (IBS)
The function riskRegression::Score() also summarizes IBS
when specifying argument summary = "ibs". We can extract
the IBS corresponding to the largest evaluation time point.
Brier_validate_ibs = Brier_validate[Brier_validate$model == "Brier_validate", ]
Brier_validate_ibs$IBS[which.max(Brier_validate_ibs$times)][1] 0.1711617Uncertainty Quantification
It is recommended to use resampling-based methods for estimating the uncertainty of the model’s performance, if there are no independent validation data for model evaluation. This can be done for example by repeatedly splitting the dataset to training/validation sets and evaluating a model’s performance on the different validation sets using various discrimination or calibration metrics.
We demonstrate how to randomly split the data, e.g. \(100\) times, train a Lasso Cox model and
estimate the integrated AUC based on the validation data in each
replication. For other Cox-type models, we can just replace the model
fitting part cv.glmnet() (and predict()) in
the for loop below. However, most of the Bayesian Cox
models introduced previously are computationally time-consuming when
randomly splitting the data many times.
# split the data 100 times
set.seed(123)
k = 100
iAUC = rep(NA, k)
for (i in 1:k) {
idx = sample(1:n, n * 0.8, replace = FALSE)
x_train = x[idx, ]
y_train = y[idx, ]
x_validate = x[-idx, ]
y_validate = y[-idx, ]
cvfit = cv.glmnet(x_train, y_train, family = "cox", nfolds = 5, penalty.factor = pf)
pred_lp = predict(cvfit, newx = x_validate, s = cvfit$lambda.min, type = "link")
utimes = sort(unique(y_validate[y_validate[, 2] == 1, 1]))
AUC = rep(NA, length(utimes))
for (j in 1:length(utimes)) {
out = CoxWeights(marker = pred_lp, Stime = y_validate[, 1], status = y_validate[, 2], predict.time = utimes[j])
AUC[j] = out$AUC
}
surv_prob = unique(survfit(Surv(y_validate[, 1], y_validate[, 2]) ~ 1)$surv)
iAUC[i] = IntegrateAUC(AUC, utimes, surv_prob, tmax = 10)
}
dat_tmp = data.frame(x = "Lasso Cox", y = iAUC)
set.seed(123)
ggplot(dat_tmp, aes(x, y)) + geom_boxplot() + ylim(0.5, 1) + xlab("") + ylab("Integrated AUC") +
geom_jitter(color="blue", size = 0.5, alpha = 0.5)
Integrated AUC based on randomly split validation data 100 times. The blue dots are the 100 values of integrated AUC.
Similar to obtaining uncertainty of the integrated AUC, we can also estimate the uncertainty of the C-index for evaluating the global performance of our model’s discrimination.
# split the data 100 times
set.seed(123)
k = 100
Cindex_all = data.frame(Harrell = rep(NA, k), Uno = rep(NA, k))
for (i in 1:k) {
idx = sample(1:n, n * 0.8, replace = FALSE)
x_train = x[idx, ]
y_train = y[idx, ]
x_validate = x[-idx, ]
y_validate = y[-idx, ]
cvfit = cv.glmnet(x_train, y_train, family = "cox", nfolds = 5, penalty.factor = pf)
pred = predict(cvfit, newx = x_validate, type = "response", s = cvfit$lambda.min)
Cindex_all$Harrell[i] = mean(apply(pred, 2, Cindex, y = y_validate))
Cindex_all$Uno[i] = UnoC(y_train, y_validate, pred)
}
dat_tmp = data.frame(x = rep(c("Harrell", "Uno"), each = k), y = unlist(Cindex_all))
set.seed(123)
ggplot(dat_tmp, aes(x, y, col = x)) + geom_boxplot() + geom_jitter(size = 0.5, alpha = 0.5) +
ylim(0, 1) + xlab("") + ylab("C-index") + theme(legend.position="none")
C-index (Harrell’s and Uno’s) based on randomly split validation data 100 times.
The R package c060
(Sill et al. 2014) includes wrapper
functions for the glmnet
algorithm and implements resampling-based methods (e.g. cross-validation
and bootstrap - with and without replacement) based on the peperr
package to calculate the time-dependent Brier score. c060
extends peperr
package to allow mandatory features without penalization. H. Binder and Schumacher (2008) recommends to draw bootstrap
samples without replacement (i.e. subsampling), because bootstrap
samples with replacement often result in too complex models in
high-dimensional settings. To use resampling by CV properly for survival
data, see R. M. Simon et al. (2011). Note that
resampling-based methods here are similar to splitting \(80\%/20\%\) the data many times which
allows us to quantify the uncertainty of the time-dependent Brier
score.
## time-dependent Brier score by subsampling from the whole data
set.seed(123)
peperr_object = peperr::peperr(response = y_surv, x = x, fit.fun = fit.glmnet,
args.fit = list(family = "cox", penalty.factor = pf),
complexity = complexity.glmnet,
args.complexity = list(family = "cox", nfolds = 5, penalty.factor = pf),
indices = resample.indices(n = n, method="sub632", sample.n = 100))
c060::Plot.peperr.curves(peperr_object)
Resampling-based prediction error curves (time-dependent Brier score) a the Lasso Cox model applied to the BRCA data set from TCGA. The gray area indicates the pointwise 2.5% and 97.5% quantiles of the 100 out-of-bag bootstrap samples. The other lines show the prediction error curves of the null model (estimated by the Kaplan-Meier estimator without covariate information), the full apparent error estimates (i.e., the errors as estimated when applying the model to the entire training data set), and the .632+ bootstrap error estimates.
Feature stability analysis
To identify stable omics features, a straightforward way is to find the overlapped omics features with nonzero coefficients among different data subsets (e.g. CV folds or resamples). The following code summarizes the Lasso Cox selected omics features which were identified at least \(2\) or \(5\) out of \(10\) resamples. Similarly, this approach can be applied to other Lasso-type or Bayesian Cox models that perform feature selection for identifying stable selected features.
# specify the number of resamples k
k = 10
beta_all = matrix(nrow = ncol(x), ncol = k)
set.seed(123)
for (j in 1:k) {
resample_id = sample(1:nrow(y), nrow(y), replace = TRUE)
resample_x = x[resample_id, ]
resample_y = y[resample_id, ]
cvfit = cv.glmnet(resample_x, resample_y, family = "cox", nfolds = 5, penalty.factor = pf)
beta_all[, j] = as.vector(coef(cvfit, s = cvfit$lambda.min))
}
(stable_features = colnames(x)[rowSums(beta_all != 0) >= 2]) [1] "age" "ethnicity" "UBE2T" "CDC6" "CCNB1" "TYMS" "CEP55" "MELK" "NDC80" "UBE2C" "PTTG1" "EXO1" "ORC6L" "ANLN" "CCNE1" "KIF2C" "ACTR3B" "MYC" "EGFR" "KRT5" "PHGDH" "CDH3" "MIA" "FOXC1" "KRT14" "ESR1" "SLC39A6" "BAG1" "MAPT" "CXXC5" "MLPH" "BCL2" "MDM2" "FOXA1" "GPR160" "FGFR4" "TMEM45B" "ERBB2" (stable_features = colnames(x)[rowSums(beta_all != 0) >= 5]) [1] "age" "ethnicity" "UBE2T" "CEP55" "UBE2C" "ORC6L" "ANLN" "ESR1" "BAG1" "MLPH" "MDM2" "GPR160" "FGFR4" "ERBB2"Alternatively for a Bayesian Cox model, its median probability model (MPM) can be obtained based on the coefficient estimates over MCMC iterations. The following code shows how to obtain the MPM’s coefficients of the penalized semiparametric Bayesian Cox model with Elastic Net prior run previously.
gammas = colMeans(matrix(as.numeric(EN_beta_p != 0), ncol = ncol(EN_beta_p)))
beta_MPM = (gammas >= 0.5) * colMeans(EN_beta_p) / gammas
beta_MPM[is.na(beta_MPM)] = 0
beta_MPM [1] 0.0000000000 -0.0172015280 0.0304316616 -0.0114623308 0.0837824132 -0.0547983327
[7] 0.1407439126 -0.0562438350 0.0233413258 0.0822548966 -0.0216956009 -0.0046531991
[13] 0.0000000000 -0.0102432707 -0.0462764281 -0.0261233503 0.1204452692 0.0498380632
[19] 0.0000000000 0.0000000000 0.0411354271 0.0008250959 -0.0747121328 0.3709996035
[25] -0.0714123785 0.0531884491 -0.0263379552 -0.0278157511 0.0868213917 -0.0417584334
[31] -0.0154609980 -1.7597763992 0.0248018172 0.1583448784 0.0000000000 -0.0270275080
[37] 0.0316279851 0.1896061075 0.0359063687 -0.1373224621 -0.1648833174 0.0346494611
[43] 0.1168334315 0.0224791857 0.1336344881 -0.0047435108 0.0187484228 0.1178996364
[49] -0.1696531126 0.0573713694 -0.0308897787 -0.2130819387Graphical computation
After identifying stable omics features predictive of survival outcomes, we can draw a nomogram to allows the graphical calculation of survival probabilities for practitioners.
We demonstrate a nomogram using the stable selected features from
TCGA breast cancer data preprocessed previously. The R
package regplot draws an enhanced regression nomogram
based on the rms package.
# remove patients without reporting ethnicity
yy = y[x[, 2] != 3, ]
xx = x[x[, 2] != 3, ]
# specify the number of resamples k
k = 10
beta_all = matrix(nrow = ncol(xx), ncol = k)
set.seed(123)
for (j in 1:k) {
resample_id = sample(1:nrow(yy), nrow(yy), replace = TRUE)
resample_x = xx[resample_id, ]
resample_y = yy[resample_id, ]
cvfit = cv.glmnet(resample_x, resample_y, family = "cox", nfolds = 5, penalty.factor = pf)
beta_all[, j] = as.vector(coef(cvfit, s = cvfit$lambda.min))
}
# identify features at least 80% frequently selected
x_stable = data.frame(xx[, rowSums(beta_all != 0) >= k * 0.8])
x_stable$ethnicity = factor(x_stable$ethnicity)
levels(x_stable$ethnicity) = c("Hispanic/latino", "Not hispanic/latino")
data_tmp = data.frame(times = yy[, "time"], status = yy[, "status"], x_stable)
f = cph(formula = Surv(times, status) ~ age + ethnicity + UBE2T + ORC6L + ESR1,
data = data_tmp, x = TRUE, y = TRUE, surv = TRUE)
ddist = datadist(data_tmp)
oldoption = options(datadist = 'ddist')
surv = Survival(f)
nom = nomogram(f, fun = list(function(x) surv(1, x), function(x) surv(3, x), function(x) surv(5, x)),
funlabel = c("1-Year Survival Probability",
"3-Year Survival Probability",
"5-Year Survival Probability"),
lp = FALSE)
regplot::regplot(f, observation = data_tmp[1,], failtime = c(1, 3, 5), title = "",
prfail = FALSE, points = TRUE, showP = FALSE, subticks = TRUE) 
Nomogram developed to estimate the overall survival probability for TCGA’s BRAC patients based on demographic and Lasso Cox selected mRNA features. The red coloured symbols represent one patient’s information and predicted probabilities of 1-year, 3-year and 5-year survival.
A calibration plot is a straightforward visualization to show the prediction ability of the nomogram, i.e., the agreement between predicted survival probabilities from the final model and the KM estimated survival probabilities in different percentiles of the predicted values at a time point of interest. We demonstrate below calibration plots based on training and validation data sets, respectively.
# Calibration at 5-year time-point
# prepare suitable data format for calibration plot
set.seed(123)
train_id <- sample(1:nrow(yy), nrow(yy) * 0.8, replace = FALSE)
data_train = data_tmp[train_id, ]
data_validate = data_tmp[-train_id, ]
ddist = datadist(data_train)
options(datadist='ddist')
f_train = cph(formula = Surv(times, status) ~ age + ethnicity + UBE2T + ORC6L + ESR1,
data = data_train, x = TRUE, y = TRUE, surv = TRUE, time.inc = 5)
f_validate = cph(formula = Surv(times, status) ~ age + ethnicity + UBE2T + ORC6L + ESR1,
data = data_validate, x = TRUE, y = TRUE, surv = TRUE, time.inc = 5)
cal_train = calibrate(f_train, u = 5, cmethod = "KM", m = nrow(data_train) / 5, B = 200)
cal_validate = calibrate(f_validate, u = 5, cmethod = "KM", m = nrow(data_validate) / 5, B = 200)
pdf("TCGA_surv_calibration.pdf", width=7, height=4)
layout(matrix(1:2, nrow = 1))
plot(cal_train, lwd = 2, lty = 1, errbar.col = "seagreen3",
xlab = 'Predicted survival probability', ylab = 'Actual survival probability',
xlim = c(0,1), ylim = c(0,1), col = "seagreen3", subtitles = FALSE)
title(main = "Calibration on training data")
plot(cal_validate, lwd = 2, lty = 1, errbar.col = "seagreen3",
xlab = 'Predicted survival probability', ylab = 'Actual survival probability',
xlim = c(0,1), ylim = c(0,1), col = "seagreen3", subtitles = FALSE)
title(main = "Calibration on validation data")
dev.off()
Nomogram model calibration curves for TCGA’s BRAC patients at 5-year evaluation time-point.
Model evaluation (mlr3)
Using the mlr3 machine
learning framework and the mlr3proba
R library, we will demonstrate how to:
- Create a survival task from a dataset and split it to training and test (validation) sets
- Define a Lasso Cox model that can output both linear predictors and survival distribution predictions and train/tune it on the training set
- Make predictions using the trained Lasso Cox model on the separate test set
- Measure the performance of our model (discrimination and calibration) using several evaluation metrics
- Using resampling techniques, we will assess our model’s capacity for generalization (prediction on unseen data) and the stability of the model’s selected features
For the rest of the analysis, we will borrow the terminology from the mlr3 ecosystem of machine learning packages (e.g. task is a dataset, learner is a model, etc.). See mlr3 book for more details.
First, we load the necessary mlr3 libraries (Lang et al. 2019; Sonabend et al. 2021) and some other useful ones:
library("mlr3verse") # mlr3, mlr3pipeplines, mlr3learners, mlr3tuning, paradox, etc.
library("mlr3proba") # probabilistic learning and survival analysis
library("mlr3extralearners") # for lrn('surv.glmnet')Workflow
We construct an mlr3 survival task (TCGA BRCA dataset essentially, with normalized PAM50 gene expression features and two clinical/demographic variables) and split it into training and test sets (\(80\%/20\%\)):
# From 'Penalized Cox models' section:
# x => gene expression matrix (50 PAM50 genes) + 2 clinical variables
# y => (time, status) target matrix
data = cbind.data.frame(x, y)
# data = readRDS(file = 'data.rds')
task = mlr3proba::as_task_surv(x = data,
time = 'time', event = 'status', id = 'BRCA-TCGA')
task # see useful info about the dataset (#features, #samples, target variables)
# split to train and test sets
set.seed(42)
split = mlr3::partition(task, ratio = 0.8)
# split$train # train indices
# split$test # test indices<TaskSurv:BRCA-TCGA> (1047 x 54)
* Target: time, status
* Properties: -
* Features (52):
- dbl (52): ACTR3B, ANLN, BAG1, BCL2, BIRC5, BLVRA, CCNB1, CCNE1,
CDC20, CDC6, CDH3, CENPF, CEP55, CXXC5, EGFR, ERBB2, ESR1, EXO1,
FGFR4, FOXA1, FOXC1, GPR160, GRB7, KIF2C, KRT14, KRT17, KRT5, MAPT,
MDM2, MELK, MIA, MKI67, MLPH, MMP11, MYBL2, MYC, NAT1, NDC80, NUF2,
ORC6L, PGR, PHGDH, PTTG1, RRM2, SFRP1, SLC39A6, TMEM45B, TYMS,
UBE2C, UBE2T, age, ethnicityWe create a Lasso Cox mlr3 graph
learner (a wrapper around the glmnet::cv.glmnet()
function with the capacity to provide survival predictions), where we
specify the two clinical variables to be mandatory (i.e. no
penalization) and the \(s\) value
(\(\lambda\) parameter used for
prediction) equal to lambda.min:
#tail(task$feature_names) # age, ethnicity are the 2 last features
pf = c(rep(1, length(task$feature_names) - 2), rep(0, 2))
# define model
coxlasso = lrn('surv.cv_glmnet', alpha = 1, nfolds = 5, s = 'lambda.min',
penalty.factor = pf)
# coxlasso # see details of coxlasso learner
# coxlasso$help() # for more details
# ?mlr_graphs_distrcompositor
coxlasso_grlrn = mlr3pipelines::ppl('distrcompositor',
learner = coxlasso,
estimator = 'kaplan', # KM estimator for the baseline
form = 'ph', # Proportional Hazards form since we use a Lasso Cox model
graph_learner = TRUE
)
coxlasso_grlrn$id = 'Lasso Cox'
# coxlasso_grlrn$graph_model$plot(html = TRUE) # plot the graph learnerA Cox proportional hazards model (and Lasso Cox as a consequence) is
a semi-parametric model, which means that it does not produce survival
distribution predictions by default. However, using the function
survival::survfit.coxph() you can transform the
cv.glmnet’s output linear predictors (lp) to
survival distribution predictions. This transformation internally uses
the Breslow estimator for the cumulative baseline hazard (see
stype parameter).
Using mlr3proba (Sonabend et al. 2021), we can construct a pipeline (M. Binder et al. 2021) that combines the distribution predictions of a baseline model (e.g. Kaplan Meier) with the linear predictors of a Cox-type model (e.g. Lasso Cox). See details such as the transformation assumptions, the choice of the survival function form and the available baseline survival distribution estimators on the respective documentation.
Train the Lasso Cox model:
set.seed(3)
coxlasso_grlrn$train(task, row_ids = split$train)
# view `cv.glmnet` fit
coxlasso_grlrn$model$surv.cv_glmnet$modelCall: (if (cv) glmnet::cv.glmnet else glmnet::glmnet)(x = data, y = target, nfolds = 5L, alpha = 1, penalty.factor = c(1, ..., 0, 0), family = "cox")
Measure: Partial Likelihood Deviance
Lambda Index Measure SE Nonzero
min 0.00994 15 12.30 0.2719 15
1se 0.03656 1 12.35 0.2562 2Get the survival distribution predictions (\(distr\)) along with the linear predictors (\(lp\)):
pred = coxlasso_grlrn$predict(task, row_ids = split$test)
head(as.data.table(pred)) row_ids time status crank lp distr
1: 5 0.9527721 FALSE -3.329133 -3.329133 <list[1]>
2: 6 4.0438056 FALSE -3.800766 -3.800766 <list[1]>
3: 15 1.7385352 FALSE -2.786662 -2.786662 <list[1]>
4: 45 4.5804244 FALSE -2.761110 -2.761110 <list[1]>
5: 50 5.1279945 FALSE -3.736211 -3.736211 <list[1]>
6: 54 6.6858316 FALSE -3.499691 -3.499691 <list[1]>So for every patient in the test set, the Lasso Cox model prediction
is a linear predictor of the form \(lp =
\hat{\beta} X_{new}\). \(crank\)
stands for continuous ranking score and it’s the same as \(lp\) for the Lasso Cox model. The \(distr\) predictions are the per-patient
survival distribution predictions, implemented by the R
package distr6 which
the mlr3proba
imports. See respective documentation
on the different prediction types supported.
An example of using the distr predictions would be to
request for the survival probability at e.g. \(1,5,10,20\) years for the first two
patients in the test set:
times = c(1,5,10,20)
pred$distr$survival(times)[,c(1,2)]
# same logic for the cumulative hazard
# pred$distr$cumHazard(times)[,c(1,2)] [,1] [,2]
1 0.9993357 0.9995854
5 0.9925989 0.9953754
10 0.9804035 0.9877267
20 0.9633548 0.9769738Discrimination metrics
We want to test our Lasso Cox model and see how well it was able to discriminate the patients in the test set. For this we can use the \(lp\) predictions of Lasso Cox model and metrics such as the (time-dependent) C-index and (time-dependent) AUC.
Harrell’s C-index (Harrell et al. 1982):
harrell_c = msr('surv.cindex')
harrell_c$id = 'surv.cindex.harrell'
# harrell_c # get some details about the measure
# harrell_c$minimize # FALSE => higher C-index is better
# harrell_c$range # [0, 1] => [min, max]
# harrell_c$predict_type # uses the $crank$ predictions (equal to $lp$ for Lasso Cox
pred$score(harrell_c)surv.cindex.harrell
0.6188244 Uno’s C-index (Uno et al. 2011): (across all time points of the test set):
uno_c = msr('surv.cindex', weight_meth = 'G2')
uno_c$id = 'surv.cindex.uno'
# Uno's C needs the train data
pred$score(uno_c, task = task, train_set = split$train)surv.cindex.uno
0.6004459 Uno’s Integrated AUC (Uno et al. 2007) (across all time points of the test set):
uno_iauc = msr('surv.uno_auc')
uno_iauc$id = 'surv.uno_iauc'
# uno_iauc$param_set$values$integrated # integrated = TRUE by default
# sort(unique(pred$truth[,1])) # time points used
# uno_iauc$properties # needs the train data
pred$score(uno_iauc, task = task, train_set = split$train)surv.uno_iauc
0.6645719 Uno’s AUC at a specific time point, e.g. \(10\) years:
uno_auc = msr('surv.uno_auc', integrated = FALSE, times = 10)
uno_auc$id = 'surv.uno_auc.10'
# needs the train data
pred$score(uno_auc, task = task, train_set = split$train)surv.uno_auc.10
0.6749081 Calibration metrics
We want to test how well our Lasso Cox model was
calibrated. Usually we derive an estimation of the
error between the survival distributions (\(distr\) predictions) of the patients in the
test set and their actual survival outcomes (corresponding to the
survival task’s time and status variables).
The most frequently used metric is the Brier Score (Graf et
al. 1999):
Integrated Brier Score (IBS) (across all time points of the test set):
ibrier = msr('surv.brier', proper = TRUE)
# ibrier$help() # see documentation
# ibrier$predict_type # uses the `distr` predictions
# better to use the train data for the Kaplan-Meier estimation of the censoring distribution, but can use the test set as well
pred$score(ibrier, task = task, train_set = split$train)surv.graf
0.4044287 We can also get the standard error of IBS (the above result is the mean across all the test set’s patients) as follows:
ibrier_se = msr('surv.brier', proper = TRUE, se = TRUE)
pred$score(ibrier_se, task = task, train_set = split$train) surv.graf
0.02253927Brier Score at a specific time point, e.g. \(10\) years:
brier10 = msr('surv.brier', proper = TRUE, integrated = FALSE, times = 10)
brier10$id = 'surv.graf.10'
# better to use the train data for the Kaplan-Meier estimation of the censoring distribution, but can use the test set as well
pred$score(brier10, task = task, train_set = split$train)surv.graf.10
0.4252442 Right-censored Logarithmic Loss score (RCLL) (Avati et al. 2020):
rcll = msr('surv.rcll')
pred$score(rcll)surv.rcll
4.684644 D-calibration (Haider et al. 2020):
dcal = msr('surv.dcalib')
pred$score(dcal)surv.dcalib
32.25961 Uncertainty Quantification
Similar procedure as followed in a previous section.
We will perform a stratified split of the BRCA-TCGA
survival task to training and test sets (with a \(80\%/20\%\) ratio as before).
Stratification on the censoring indicator status is
important because we want our training and test sets to have the same
censoring distribution as the initial dataset. Thus we can avoid
measuring performance on test sets with severely different censoring
distributions that might influence the performance scores.
Stratify survival task by status:
coxlasso_grlrn$reset() # un-train model
task$col_roles$stratum = 'status'
# taskNext, we define the type of resampling
(?mlr_resamplings_subsampling), train the Lasso Cox model
on all training sets (\(100\)) and
store the fitted models for feature selection and evaluation:
# 100 times train/test split (80% for training, 20% for validation)
subsampling = rsmp('subsampling', repeats = 100, ratio = 0.8)
set.seed(42)
rr = mlr3::resample(task = task, learner = coxlasso_grlrn,
resampling = subsampling, store_models = TRUE, store_backends = TRUE)We can use all the aforementioned evaluation metrics to measure the
performance of the Lasso Cox models on the \(100\) different test sets. Note that if a
metric needs the training dataset it is automatically provided by the
ResampleResult object (rr):
measures = list(harrell_c, uno_c, uno_iauc, uno_auc, ibrier, brier10, rcll, dcal)
res = rr$score(measures = measures)
head(res) task task_id learner learner_id
1: <TaskSurv[55]> BRCA-TCGA <GraphLearner[38]> Lasso Cox
2: <TaskSurv[55]> BRCA-TCGA <GraphLearner[38]> Lasso Cox
3: <TaskSurv[55]> BRCA-TCGA <GraphLearner[38]> Lasso Cox
4: <TaskSurv[55]> BRCA-TCGA <GraphLearner[38]> Lasso Cox
5: <TaskSurv[55]> BRCA-TCGA <GraphLearner[38]> Lasso Cox
6: <TaskSurv[55]> BRCA-TCGA <GraphLearner[38]> Lasso Cox
resampling resampling_id iteration prediction
1: <ResamplingSubsampling[20]> subsampling 1 <PredictionSurv[20]>
2: <ResamplingSubsampling[20]> subsampling 2 <PredictionSurv[20]>
3: <ResamplingSubsampling[20]> subsampling 3 <PredictionSurv[20]>
4: <ResamplingSubsampling[20]> subsampling 4 <PredictionSurv[20]>
5: <ResamplingSubsampling[20]> subsampling 5 <PredictionSurv[20]>
6: <ResamplingSubsampling[20]> subsampling 6 <PredictionSurv[20]>
surv.cindex.harrell surv.cindex.uno surv.uno_iauc surv.uno_auc.10 surv.graf
1: 0.5679167 0.6090304 0.6628350 0.4719335 0.3255181
2: 0.5422131 0.4884603 0.4023684 0.5652588 0.3148992
3: 0.7604049 0.5740556 0.5941948 0.5235439 0.2855151
4: 0.6610169 0.5277736 0.5360690 0.5110032 0.2972719
5: 0.5800073 0.5655076 0.6160743 0.5388393 0.3518505
6: 0.5427837 0.6975740 0.6494779 0.6400328 0.2035609
surv.graf.10 surv.rcll surv.dcalib
1: 0.6161825 6.038909 1.026901e+07
2: 0.4473104 5.400253 1.050427e+04
3: 0.2969766 4.953528 2.544116e+01
4: 0.2365322 4.953830 2.275040e+01
5: 0.4387165 4.943446 3.370510e+01
6: 0.4228169 5.434970 4.223742e+02We extract and visualize the discrimination and calibration (resampled) performance of our Lasso Cox model using several evaluation metrics:
set.seed(42)
# C-indexes, AUCs (integrated and at t = 10 years)
res[, .(surv.cindex.harrell, surv.cindex.uno, surv.uno_iauc, surv.uno_auc.10)] %>%
tidyr::pivot_longer(cols = tidyselect::everything(),
names_to = 'Measure', values_to = 'Value') %>%
mutate(Measure = case_when(
Measure == 'surv.cindex.harrell' ~ 'Harrell\'s C-index',
Measure == 'surv.cindex.uno' ~ 'Uno\'s C-index',
Measure == 'surv.uno_iauc' ~ 'Uno\'s Integrated AUC',
Measure == 'surv.uno_auc.10' ~ 'Uno\'s AUC (t = 10 years)',
)) %>%
mutate(Measure = factor(Measure, levels = c(
'Harrell\'s C-index',
'Uno\'s C-index',
'Uno\'s Integrated AUC',
'Uno\'s AUC (t = 10 years)'))) %>%
ggplot(aes(x = Measure, y = Value, fill = Measure)) +
geom_boxplot() +
ylim(c(0.2, 0.8)) +
geom_hline(yintercept = 0.5, color = 'red', linetype = 'dashed') +
theme_bw(base_size = 14) +
labs(title = 'Discrimination Measures') +
theme(axis.text.x = element_blank())
Discrimination performance of Lasso Cox on the TCGA-BRCA dataset (expression data of the PAM50 genes and the variables age and ethnicity). Performance metrics used are Harrell’s C-index, Uno’s C-index, Uno’s Integrated AUC and Uno’s AUC at 10 years. The dataset was split to training/validation sets 100 times to allow for the quantification of uncertainty in the different performance estimates.
# different scales for each measure, so we separate the plots
set.seed(42)
# Integrated Brier Score and Brier Score at t = 10 years
res[, .(surv.graf, surv.graf.10)] %>%
tidyr::pivot_longer(cols = tidyselect::everything(),
names_to = 'Measure', values_to = 'Value') %>%
mutate(Measure = case_when(
Measure == 'surv.graf' ~ 'IBS',
Measure == 'surv.graf.10' ~ 'BS(t=10)'
)) %>%
ggplot(aes(x = Measure, y = Value, fill = Measure)) +
geom_boxplot(show.legend = FALSE) +
geom_jitter(color = 'blue', size = 0.5, alpha = 0.5, show.legend = FALSE) +
labs(title = 'Integrated Brier Score vs Brier Score (t = 10 years)') +
theme_bw(base_size = 14) +
theme(axis.title.x = element_blank())
# RCLL
res[, .(surv.rcll)] %>%
tidyr::pivot_longer(cols = tidyselect::everything(),
names_to = 'Measure', values_to = 'Value') %>%
mutate(Measure = case_when(
Measure == 'surv.rcll' ~ 'RCLL'
)) %>%
ggplot(aes(x = Measure, y = Value)) +
geom_boxplot(show.legend = FALSE) +
geom_jitter(color = 'blue', size = 0.5, alpha = 0.5, show.legend = FALSE) +
labs(title = 'Right-censored Log Loss') +
theme_bw(base_size = 14) +
theme(axis.title.x = element_blank())
Calibration performance of Lasso Cox on the TCGA-BRCA dataset
(expression data of the PAM50 genes and the variables age and
ethnicity). Performance metrics used are the Integrated Brier Score
(IBS), the Brier Score at 10 years and the Right-Censored Logarithmic
Loss (RCLL). The dataset was split to training/validation sets 100 times
to allow for the quantification of uncertainty in the different
performance estimates.
Feature stability analysis
We can extract the selected features from all \(100\) trained Lasso Cox models and create a frequency selection table:
# get selected features from all trained learners in a list
sf_list = lapply(rr$learners, function(learner) {
learner$graph_model$pipeops$surv.cv_glmnet$learner_model$selected_features()
})
# make frequency selection table
n = length(sf_list)
fs_res = sort(table(unlist(sf_list)), decreasing = TRUE)
times = as.vector(unname(fs_res))
tibble::tibble(feat_name = names(fs_res), times = times, freq = times/n)# A tibble: 35 × 3
feat_name times freq
<chr> <int> <dbl>
1 age 100 1
2 ethnicity 100 1
3 UBE2T 53 0.53
4 ORC6L 48 0.48
5 ANLN 42 0.42
6 ERBB2 40 0.4
7 GPR160 35 0.35
8 FGFR4 33 0.33
9 CEP55 32 0.32
10 UBE2C 30 0.3
# … with 25 more rowsAs age and ethnicity were not penalized,
they have non-zero coefficients in all Lasso Cox models and therefore
are included in all selected feature sets.
Lastly, we can use the R package stabm
(Bommert and Lang 2021) to assess how
similar the \(100\) selected feature
sets were. We will demonstrate the use of three metrics which measure
the stability of the Lasso Cox’s feature selection on the
TCGA-BRCA dataset:
- The Jaccard index
- Nogueira’s metric (corrected for chance, i.e. independent of the number of features; Nogueira, Sechidis, and Brown (2018))
- Zucknick’s metric (extension of Jaccard index that considers the correlation between the features; Zucknick, Richardson, and Stronach (2008)):
set.seed(42)
jac = stabm::stabilityJaccard(features = sf_list, correction.for.chance = 'none')
nog = stabm::stabilityNogueira(features = sf_list, p = length(task$feature_names))
# Similarity of each pair of features using Pearson correlation
sim.mat = abs(stats::cor(x = task$data(cols = task$feature_names), method = 'p'))
zuck = stabm::stabilityZucknick(features = sf_list, sim.mat = sim.mat,
threshold = 0.9, correction.for.chance = 'estimate', N = 100)
tibble::tibble(jaccard = jac, nogueira = nog, zucknick = zuck)# A tibble: 1 × 3
jaccard nogueira zucknick
<dbl> <dbl> <dbl>
1 0.439 0.412 0.402From the above values we conclude that the stability of Lasso Cox’s feature selection is neither poor nor excellent but somewhere in between.
R session info
sessionInfo()R version 4.2.1 (2022-06-23)
Platform: x86_64-pc-linux-gnu (64-bit)
Running under: Ubuntu 20.04.5 LTS
Matrix products: default
BLAS: /usr/lib/x86_64-linux-gnu/blas/libblas.so.3.9.0
LAPACK: /usr/lib/x86_64-linux-gnu/lapack/liblapack.so.3.9.0
locale:
[1] LC_CTYPE=en_US.UTF-8 LC_NUMERIC=C LC_TIME=en_US.UTF-8 LC_COLLATE=en_US.UTF-8
[5] LC_MONETARY=en_US.UTF-8 LC_MESSAGES=en_US.UTF-8 LC_PAPER=en_US.UTF-8 LC_NAME=C
[9] LC_ADDRESS=C LC_TELEPHONE=C LC_MEASUREMENT=en_US.UTF-8 LC_IDENTIFICATION=C
attached base packages:
[1] stats4 stats graphics grDevices utils datasets methods base
other attached packages:
[1] stabm_1.2.1 mlr3extralearners_0.6.1 mlr3proba_0.5.2
[4] mlr3verse_0.2.7 mlr3_0.14.1 regplot_1.1
[7] survAUC_1.1-1 rms_6.3-0 SparseM_1.81
[10] Hmisc_4.7-1 lattice_0.20-45 c060_0.2-9
[13] peperr_1.4 snowfall_1.84-6.2 snow_0.4-4
[16] riskRegression_2022.09.23 risksetROC_1.0.4.1 MASS_7.3-57
[19] BhGLM_1.1.0 GGally_2.1.2 psbcGroup_1.5
[22] mvtnorm_1.1-3 SuppDists_1.1-9.7 LearnBayes_2.15.1
[25] SGL_1.3 grpreg_3.4.0 plotmo_3.6.2
[28] TeachingDemos_2.12 plotrix_3.8-2 Formula_1.2-4
[31] glmnet_4.1-4 Matrix_1.5-1 M3C_1.20.0
[34] survminer_0.4.9 ggpubr_0.4.0 survival_3.4-0
[37] ggplot2_3.4.0 dplyr_1.0.10 DESeq2_1.38.3
[40] SummarizedExperiment_1.28.0 Biobase_2.58.0 GenomicRanges_1.50.2
[43] GenomeInfoDb_1.34.6 IRanges_2.32.0 S4Vectors_0.36.1
[46] BiocGenerics_0.44.0 MatrixGenerics_1.10.0 matrixStats_0.63.0
[49] TCGAbiolinks_2.25.3
loaded via a namespace (and not attached):
[1] rappdirs_0.3.3 vioplot_0.4.0 tidyr_1.2.1
[4] bit64_4.0.5 knitr_1.40 multcomp_1.4-20
[7] DelayedArray_0.24.0 data.table_1.14.6 rpart_4.1.19
[10] KEGGREST_1.38.0 RCurl_1.98-1.9 doParallel_1.0.17
[13] generics_0.1.3 timereg_2.0.4 tgp_2.4-21
[16] TH.data_1.1-1 RSQLite_2.2.20 polspline_1.1.20
[19] proxy_0.4-27 future_1.31.0 bit_4.0.4
[22] tzdb_0.3.0 xml2_1.3.3 assertthat_0.2.1
[25] xfun_0.33 hms_1.1.2 evaluate_0.20
[28] fansi_1.0.3 progress_1.2.2 dbplyr_2.2.1
[31] km.ci_0.5-6 DBI_1.1.3 geneplotter_1.76.0
[34] htmlwidgets_1.5.4 reshape_0.8.9 purrr_1.0.1
[37] ellipsis_0.3.2 mlr3data_0.6.1 RSpectra_0.16-1
[40] backports_1.4.1 annotate_1.76.0 biomaRt_2.54.0
[43] deldir_1.0-6 vctrs_0.5.1 quantreg_5.94
[46] abind_1.4-5 cachem_1.0.6 withr_2.5.0
[49] mlr3learners_0.5.6 checkmate_2.1.0 prettyunits_1.1.1
[52] mlr3fselect_0.9.1 param6_0.2.4 cluster_2.1.3
[55] crayon_1.5.2 pkgconfig_2.0.3 nlme_3.1-157
[58] mlegp_3.1.9 nnet_7.3-17 rlang_1.0.6
[61] globals_0.16.2 lifecycle_1.0.3 MatrixModels_0.5-1
[64] sandwich_3.0-2 downloader_0.4 filelock_1.0.2
[67] palmerpenguins_0.1.1 BiocFileCache_2.6.0 mets_1.3.1
[70] doSNOW_1.0.20 KMsurv_0.1-5 carData_3.0-5
[73] boot_1.3-28 zoo_1.8-11 base64enc_0.1-3
[76] png_0.1-8 bitops_1.0-7 Biostrings_2.66.0
[79] blob_1.2.3 shape_1.4.6 paradox_0.11.0
[82] stringr_1.5.0 parallelly_1.34.0 readr_2.1.3
[85] jpeg_0.1-9 rstatix_0.7.1 dictionar6_0.1.3
[88] ggsignif_0.6.4 scales_1.2.1 memoise_2.0.1
[91] magrittr_2.0.3 plyr_1.8.8 zlibbioc_1.44.0
[94] compiler_4.2.1 RColorBrewer_1.1-3 clue_0.3-63
[97] lme4_1.1-31 set6_0.2.5 cli_3.4.1
[100] XVector_0.38.0 mlr3tuningspaces_0.3.3 mlr3filters_0.7.0
[103] listenv_0.9.0 htmlTable_2.4.1 tidyselect_1.2.0
[106] stringi_1.7.12 TCGAbiolinksGUI.data_1.18.0 distr6_1.6.13
[109] yaml_2.3.5 askpass_1.1 locfit_1.5-9.6
[112] latticeExtra_0.6-30 survMisc_0.5.6 grid_4.2.1
[115] maptree_1.4-8 tools_4.2.1 mlr3misc_0.11.0
[118] mlr3cluster_0.1.6 future.apply_1.10.0 parallel_4.2.1
[121] matrixcalc_1.0-6 rstudioapi_0.14 uuid_1.1-0
[124] foreach_1.5.2 foreign_0.8-82 gridExtra_2.3
[127] prodlim_2019.11.13 Rtsne_0.16 digest_0.6.31
[130] lava_1.7.0 cmprsk_2.2-11 Rcpp_1.0.10
[133] car_3.1-1 broom_1.0.1 httr_1.4.4
[136] AnnotationDbi_1.60.0 mlr3tuning_0.17.2 colorspace_2.0-3
[139] rvest_1.0.3 XML_3.99-0.13 reticulate_1.26
[142] umap_0.2.9.0 splines_4.2.1 lgr_0.4.4
[145] bbotk_0.7.2 sm_2.2-5.7.1 statmod_1.4.37
[148] mlr3pipelines_0.4.2 xtable_1.8-4 nloptr_2.0.3
[151] jsonlite_1.8.3 corpcor_1.6.10 clusterCrit_1.2.8
[154] R6_2.5.1 pillar_1.8.1 htmltools_0.5.3
[157] minqa_1.2.5 glue_1.6.2 fastmap_1.1.0
[160] BiocParallel_1.32.5 beanplot_1.3.1 class_7.3-20
[163] ooplah_0.2.0 codetools_0.2-18 utf8_1.2.2
[166] tibble_3.1.8 numDeriv_2016.8-1.1 curl_4.3.3
[169] mlr3viz_0.6.1 openssl_2.0.3 interp_1.1-3
[172] penalizedSVM_1.1.3 rmarkdown_2.17 munsell_0.5.0
[175] e1071_1.7-12 GenomeInfoDbData_1.2.9 iterators_1.0.14
[178] gtable_0.3.1 References
Antolini, Laura, Patrizia Boracchi, Elia Biganzoli, L Antolini, P
Boracchi, and E Biganzoli. 2005. “A
time-dependent discrimination index for survival data.”
Statistics in Medicine 24 (24): 3927–44. https://doi.org/10.1002/SIM.2427.
Avati, Anand, Tony Duan, Sharon Zhou, Kenneth Jung, Nigam H Shah, and
Andrew Y Ng. 2020. “Countdown Regression:
Sharp and Calibrated Survival Predictions.” In
Proceedings of the 35th Uncertainty in Artificial Intelligence
Conference, edited by Ryan P Adams and Vibhav Gogate, 115:145–55.
Proceedings of Machine Learning Research. PMLR. https://proceedings.mlr.press/v115/avati20a.html.
Binder, Harald, and Martin Schumacher. 2008. “Adapting Prediction
Error Estimates for Biased Complexity Selection in High-Dimensional
Bootstrap Samples.” Statistical Applications in Genetics and
Molecular Biology 7 (1). https://doi.org/10.2202/1544-6115.1346.
Binder, Martin, Florian Pfisterer, Michel Lang, Lennart Schneider, Lars
Kotthoff, and Bernd Bischl. 2021. “Mlr3pipelines - Flexible
Machine Learning Pipelines in r.” Journal of Machine Learning
Research 22 (184): 1–7. http://jmlr.org/papers/v22/21-0281.html.
Blanche, Paul, Michael W Kattan, and Thomas A Gerds. 2019. “The c-index is not proper for the evaluation of t-year
predicted risks.” Biostatistics 20 (2): 347–57.
https://doi.org/10.1093/biostatistics/kxy006.
Bommert, Andrea, and Michel Lang. 2021. “stabm: Stability Measures for Feature
Selection.” Journal of Open Source Software 6 (59):
3010. https://doi.org/10.21105/joss.03010.
Breheny, Patrick, and Jian Huang. 2015. “Group Descent Algorithms
for Nonconvex Penalized Linear and Logistic Regression Models with
Grouped Predictors.” Statistics and Computing 25:
173–87.
Breheny, Patrick, Yaohui Zeng, and Ryan Kurth. 2021. “Grpreg:
Regularization Paths for Regression Models with Grouped
Covariates.” R Package Version 3.4.0. https://CRAN.R-project.org/package=grpreg (23 January
2023, date last accessed).
Friedman, Jerome, Trevor Hastie, and Robert Tibshirani. 2010.
“Regularization Paths for Generalized Linear Models via Coordinate
Descent.” Journal of Statistical Software 33 (1): 1–22.
https://doi.org/10.18637/jss.v033.i01.
Graf, Erika, Claudia Schmoor, Willi Sauerbrei, and Martin Schumacher.
1999. “Assessment and comparison of
prognostic classification schemes for survival data.”
Statistics in Medicine 18: 2529–45. https://doi.org/10.1002/(SICI)1097-0258(19990915/30)18:17/18.
Haider, Humza, Bret Hoehn, Sarah Davis, and Russell Greiner. 2020.
“Effective Ways to Build and Evaluate
Individual Survival Distributions.” Journal of Machine
Learning Research 21 (85): 1–63. http://jmlr.org/papers/v21/18-772.html.
Harrell, Frank E., Robert M. Califf, David B. Pryor, Kerry L. Lee, and
Robert A. Rosati. 1982. “Evaluating the Yield
of Medical Tests.” JAMA: The Journal of the American
Medical Association 247 (18): 2543–46. https://doi.org/10.1001/jama.1982.03320430047030.
Heagerty, Patrick J., and Yingye Zheng. 2005. “Survival Model Predictive Accuracy and ROC
Curves.” Biometrics 61 (1): 92–105. https://doi.org/10.1111/J.0006-341X.2005.030814.X.
John, Christopher R, David Watson, Dominic Russ, Katriona Goldmann,
Michael Ehrenstein, Costantino Pitzalis, Myles Lewis, and Michael
Barnes. 2020. “M3C: Monte Carlo Reference-Based
Consensus Clustering.” Scientific Reports 10 (1): 1816.
https://doi.org/10.1038/s41598-020-58766-1.
Lang, Michel, Martin Binder, Jakob Richter, Patrick Schratz, Florian
Pfisterer, Stefan Coors, Quay Au, Giuseppe Casalicchio, Lars Kotthoff,
and Bernd Bischl. 2019. “mlr3: A modern
object-oriented machine learning framework in R.”
Journal of Open Source Software 4 (44): 1903. https://doi.org/10.21105/JOSS.01903.
Lee, Kyu Ha, Sounak Chakraborty, and Jianguo Sun. 2021. “psbcGroup: Penalized Parametric and Semiparametric
Bayesian Survival Models with Shrinkage and Grouping
Priors.” R Package Version 1.5. https://CRAN.R-project.org/package=psbcGroup (23 January
2023, date last accessed).
Love, Michael I., Wolfgang Huber, and Simon Anders. 2014.
“Moderated Estimation of Fold Change and Dispersion for RNA-Seq
Data with DESeq2.” Genome Biology 15: 550. https://doi.org/10.1186/s13059-014-0550-8.
Mounir, Marta AND Silva, Mohamed AND Lucchetta. 2019. “New
Functionalities in the TCGAbiolinks Package for the Study and
Integration of Cancer Data from GDC and GTEx.” PLOS
Computational Biology 15 (3): 1–18. https://doi.org/10.1371/journal.pcbi.1006701.
Nogueira, Sarah, Konstantinos Sechidis, and Gavin Brown. 2018.
“On the Stability of Feature Selection
Algorithms.” Journal of Machine Learning Research
18 (174): 1–54. http://jmlr.org/papers/v18/17-514.html.
Parker, Joel S., Michael Mullins, Maggie C. U. Cheang, Samuel Leung,
David Voduc, Tammi Vickery, Sherri Davies, et al. 2009.
“Supervised Risk Predictor of Breast Cancer Based on Intrinsic
Subtypes.” Journal of Clinical Oncology 27 (8): 1160–67.
https://doi.org/10.1200/JCO.2008.18.1370.
Sill, Martin, Thomas Hielscher, Natalia Becker, and Manuela Zucknick.
2014. “c060: Extended Inference with
Lasso and Elastic-Net Regularized Cox and Generalized Linear
Models.” Journal of Statistical Software 62 (5): 1–22.
https://doi.org/10.18637/jss.v062.i05.
Simon, Noah, Jerome Friedman, Trevor Hastie, and Rob Tibshirani. 2019.
“SGL: Fit a GLM (or Cox Model) with a
Combination of Lasso and Group Lasso Regularization.”
R Package Version 1.3. https://CRAN.R-project.org/package=SGL (23 January 2023,
date last accessed).
Simon, Richard M., Jyothi Subramanian, Ming-Chung Li, and Supriya
Menezes. 2011. “Using cross-validation to
evaluate predictive accuracy of survival risk classifiers based on
high-dimensional data.” Briefings in
Bioinformatics 12 (3): 203–14. https://doi.org/10.1093/bib/bbr001.
Sonabend, Raphael, Franz J. Király, Andreas Bender, Bernd Bischl, and
Michel Lang. 2021. “mlr3proba: an R package
for machine learning in survival analysis.”
Bioinformatics 37 (17): 2789–91. https://doi.org/10.1093/BIOINFORMATICS/BTAB039.
Uno, Hajime, Tianxi Cai, Michael J. Pencina, Ralph B. D’Agostino, and L.
J. Wei. 2011. “On the C-statistics for
evaluating overall adequacy of risk prediction procedures with censored
survival data.” Statistics in Medicine 30 (10):
1105–17. https://doi.org/10.1002/SIM.4154.
Uno, Hajime, Tianxi Cai, Lu Tian, and L. J. Wei. 2007. “Evaluating Prediction Rules for t-Year Survivors With
Censored Regression Models.” Journal of the American
Statistical Association 102 (478): 527–37. https://doi.org/10.1198/016214507000000149.
Yi, Nengjun, Zaixiang Tang, Xinyan Zhang, and Boyi Guo. 2019.
“BhGLM: Bayesian hierarchical GLMs and
survival models, with applications to genomics and
epidemiology.” Bioinformatics 35 (8): 1419–21. https://doi.org/10.1093/bioinformatics/bty803.
Zhao, Yingdong, Ming-Chung Li, Mariam M. Konate, Li Chen, Biswajit Das,
Chris Karlovich, P. Mickey Williams, Yvonne A. Evrard, James H.
Doroshow, and Lisa M. McShane. 2021. “TPM, FPKM, or Normalized
Counts? A Comparative Study of Quantification Measures for the Analysis
of RNA-Seq Data from the NCI Patient-Derived Models Repository.”
Journal of Translational Medicine 19 (1): 269. https://doi.org/10.1186/s12967-021-02936-w.
Zucknick, Manuela, Sylvia Richardson, and Euan A Stronach. 2008.
“Comparing the Characteristics of Gene Expression Profiles Derived
by Univariate and Multivariate Classification Methods.”
Statistical Applications in Genetics and Molecular Biology 7
(1). https://doi.org/doi:10.2202/1544-6115.1307.
Zucknick, Manuela, Maral Saadati, and Axel Benner. 2015. “Nonidentical twins: Comparison of frequentist and
Bayesian lasso for Cox models.” Biometrical
Journal 57 (6): 959–81. https://doi.org/10.1002/bimj.201400160.
LS0tCnRpdGxlOiAiU3VwcGxlbWVudGFsIGluZm9ybWF0aW9uIGZvciAnVHV0b3JpYWwgb24gc3Vydml2YWwgbW9kZWxsaW5nIHdpdGggb21pY3MgZGF0YSciCmF1dGhvcjogIltaaGkgWmhhb10oaHR0cHM6Ly9naXRodWIuY29tL3poaXp1aW8pIGFuZCBbSm9obiBab2JvbGFzXShodHRwczovL2dpdGh1Yi5jb20vYmJsb2Rmb24pIgpkYXRlOiAiTGFzdCB1cGRhdGVkOiBgciBmb3JtYXQoU3lzLnRpbWUoKSwgJyVkICVCLCAlWScpYCIKb3V0cHV0OgogIGh0bWxfZG9jdW1lbnQ6CiAgICBjc3M6IHN0eWxlLmNzcwogICAgdGhlbWU6IHVuaXRlZAogICAgdG9jOiB0cnVlCiAgICB0b2NfZmxvYXQ6CiAgICAgIGNvbGxhcHNlZDogdHJ1ZQogICAgICBzbW9vdGhfc2Nyb2xsOiB0cnVlCiAgICB0b2NfZGVwdGg6IDQKICAgIG51bWJlcl9zZWN0aW9uczogZmFsc2UKICAgIGNvZGVfZm9sZGluZzogc2hvdwogICAgY29kZV9kb3dubG9hZDogdHJ1ZQpiaWJsaW9ncmFwaHk6IHJlZmVyZW5jZXMuYmliCmxpbmstY2l0YXRpb25zOiB0cnVlCi0tLQoKYGBge3IsIGluY2x1ZGU9RkFMU0V9CmtuaXRyOjpvcHRzX2NodW5rJHNldCgKICBjb21tZW50ID0gJycsIGV2YWwgPSBGQUxTRQopCmBgYAo8YnI+ClRoaXMgaXMgYW4gW1IgTWFya2Rvd25dKGh0dHA6Ly9ybWFya2Rvd24ucnN0dWRpby5jb20pIHN1cHBsZW1lbnQgZm9yIHRoZSBhcnRpY2xlICoqX1R1dG9yaWFsIG9uIHN1cnZpdmFsIG1vZGVsbGluZyB3aXRoIG9taWNzIGRhdGFfKiouCgojIEludHJvZHVjdGlvbiB7LX0KCltUaGUgQ2FuY2VyIEdlbm9tZSBBdGxhc10oaHR0cHM6Ly93d3cuY2FuY2VyLmdvdi9hYm91dC1uY2kvb3JnYW5pemF0aW9uL2NjZy9yZXNlYXJjaC9zdHJ1Y3R1cmFsLWdlbm9taWNzL3RjZ2EpIChUQ0dBKSBwcm92aWRlcyBhbiBlbm9ybW91cyBjb2xsZWN0aW9uIG9mIGNhbmNlciBkYXRhIHNldHMsIGluY2x1ZGluZyBzdXJ2aXZhbCwgY2xpbmljYWwgYW5kIG11bHRpLW9taWNzIGRhdGEuCgo6Ojp7LmdyZWVuLWJveH0KV2Ugd2lsbCB1c2UgVENHQSBkYXRhIHRvIGRlbW9uc3RyYXRlOgoKLSBUaGUgZGlmZmVyZW50IGRhdGEgdHlwZXMKLSBQcmVwcm9jZXNzaW5nIG9mIHN1cnZpdmFsIGFuZCBvbWljcyBkYXRhCi0gQW5hbHlzaXMgb2Ygc3Vydml2YWwgZGF0YSBieSBjbGFzc2ljYWwgc3RhdGlzdGljYWwgbWV0aG9kcwotIFVuc3VwZXJ2aXNlZCBsZWFybmluZyBmb3Igb21pY3MgZGF0YQotIEZyZXF1ZW50aXN0ICYgQmF5ZXNpYW4gc3VwZXJ2aXNlZCBsZWFybmluZyBmb3Igc3Vydml2YWwgYW5kIG9taWNzIGRhdGEKOjo6CgojIFRDR0Egc3Vydml2YWwgYW5kIGNsaW5pY2FsIGRhdGEgey19CgpUaGUgUi9CaW9jb25kdWN0b3IgcGFja2FnZSBbKipUQ0dBYmlvbGlua3MqKl0oaHR0cHM6Ly9iaW9jb25kdWN0b3Iub3JnL3BhY2thZ2VzL1RDR0FiaW9saW5rcy8pIFtATW91bmlyMjAxOV0gcHJvdmlkZXMgYSBmZXcgZnVuY3Rpb25zIHRvIGRvd25sb2FkIGFuZCBwcmVwcm9jZXNzIGNsaW5pY2FsIGFuZCBtdWx0aS1vbWljcyBkYXRhIGZyb20gdGhlIFtHZW5vbWljIERhdGEgQ29tbW9uc10oaHR0cHM6Ly9nZGMuY2FuY2VyLmdvdi8pIChHREMpIERhdGEgUG9ydGFsIGZvciBmdXJ0aGVyIGFuYWx5c2lzLgoKRmlyc3Qgd2UgbG9hZCBhbGwgbmVjZXNzYXJ5IGxpYnJhcmllcyB1c2VkIGluIHRoaXMgdHV0b3JpYWwgZXhjZXB0IFsqKm1scjMqKiBsaWJyYXJpZXNdKCNtbHIzKSB3aGljaCB3aWxsIGJlIGludHJvZHVjZWQgbGF0ZXIuIApUaGVuIHdlIHVzZSBmdW5jdGlvbiBgR0RDcXVlcnlfY2xpbmljKClgIGZyb20gKipUQ0dBYmlvbGlua3MqKiBwYWNrYWdlIHRvIHF1ZXJ5IGFuZCBkb3dubG9hZCBUQ0dBIHN1cnZpdmFsIGFuZCBjbGluaWNhbCBkYXRhIGZyb20gbXVsdGlwbGUgY2FuY2VyIHR5cGVzOgoKYGBge3J9CiMgbG9hZCBhbGwgbGlicmFyaWVzIHVzZWQgaW4gdGhpcyB0dXRvcmlhbCBleGNlcHQgbWxyMwpsaWJyYXJ5KCJUQ0dBYmlvbGlua3MiKQpsaWJyYXJ5KCJTdW1tYXJpemVkRXhwZXJpbWVudCIpCmxpYnJhcnkoIkRFU2VxMiIpCmxpYnJhcnkoImRwbHlyIikKbGlicmFyeSgiZ2dwbG90MiIpCmxpYnJhcnkoInN1cnZpdmFsIikKbGlicmFyeSgic3Vydm1pbmVyIikKbGlicmFyeSgiTTNDIikKbGlicmFyeSgiZ2xtbmV0IikKbGlicmFyeSgicGxvdG1vIikKbGlicmFyeSgiZ3JwcmVnIikKbGlicmFyeSgiU0dMIikKbGlicmFyeSgicHNiY0dyb3VwIikKbGlicmFyeSgiR0dhbGx5IikKbGlicmFyeSgiQmhHTE0iKQpsaWJyYXJ5KCJyaXNrc2V0Uk9DIikKbGlicmFyeSgicmlza1JlZ3Jlc3Npb24iKQpsaWJyYXJ5KCJwZXBlcnIiKQpsaWJyYXJ5KCJjMDYwIikKbGlicmFyeSgicm1zIikKbGlicmFyeSgic3VydkFVQyIpCmxpYnJhcnkoInJlZ3Bsb3QiKQpgYGAKCmBgYHtyfQojIGRvd25sb2FkIHRoZSBjbGluaWNhbCBkYXRhIGFuZCBleHRyYWN0IGRhdGEgZm9yIG11bHRpcGxlIGNhbmNlcnMgdXNpbmcgR0RDIGFwaSBtZXRob2QKY2FuY2VyX3R5cGVzID0gYygiVENHQS1CTENBIiwgIlRDR0EtQlJDQSIsICJUQ0dBLUNPQUQiLCAiVENHQS1MSUhDIiwgCiAgICAgICAgICAgICAgICAgICJUQ0dBLUxVQUQiLCAiVENHQS1QQUFEIiwgIlRDR0EtUFJBRCIsICJUQ0dBLVRIQ0EiKQpjbGluID0gTlVMTApmb3IgKGkgaW4gc2VxX2Fsb25nKGNhbmNlcl90eXBlcykpIHsKICB0bXAgPSBUQ0dBYmlvbGlua3M6OkdEQ3F1ZXJ5X2NsaW5pYyhwcm9qZWN0ID0gY2FuY2VyX3R5cGVzW2ldLCB0eXBlID0gImNsaW5pY2FsIikKICBjbGluID0gcmJpbmQoY2xpbiwgdG1wWywgYygicHJvamVjdCIsICJzdWJtaXR0ZXJfaWQiLCAidml0YWxfc3RhdHVzIiwgCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICJkYXlzX3RvX2xhc3RfZm9sbG93X3VwIiwgImRheXNfdG9fZGVhdGgiLCAKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgImFnZV9hdF9kaWFnbm9zaXMiLCAiZ2VuZGVyIiwgInJhY2UiLCAKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgImV0aG5pY2l0eSIsICJhamNjX3BhdGhvbG9naWNfdCIpXSkKfQoKIyBleHRyYWN0IHRoZSBvYnNlcnZlZCB0aW1lIGZvciBlYWNoIHBhdGllbnQgYW5kIHVzZSB5ZWFycyBhcyB1bml0CmNsaW4kdGltZSA9IGFwcGx5KGNsaW5bLCBjKCJkYXlzX3RvX2RlYXRoIiwgImRheXNfdG9fbGFzdF9mb2xsb3dfdXAiKV0sIDEsIG1heCwgbmEucm0gPSBUUlVFKSAvIDM2NS4yNQpjbGluJGFnZSA9IGNsaW4kYWdlX2F0X2RpYWdub3NpcyAvIDM2NS4yNQpjbGluJHN0YXR1cyA9IGNsaW4kdml0YWxfc3RhdHVzCmNsaW4gPSBjbGluWywgYygicHJvamVjdCIsICJzdWJtaXR0ZXJfaWQiLCAic3RhdHVzIiwgInRpbWUiLCAiZ2VuZGVyIiwgImFnZSIsICJyYWNlIiwgImV0aG5pY2l0eSIpXQoKY2xpbiA9IGNsaW5bKGNsaW4kdGltZSA+IDApICYgKGNsaW4kc3RhdHVzICVpbiUgYygiQWxpdmUiLCAiRGVhZCIpKSwgXQoKIyBmcmVxdWVuY3kgdGFibGUgb2YgdGhlIHBhdGllbnRzIHcuci50LiBzdGF0dXMsIGdlbmRlciBhbmQgZXRobmljaXR5CmNsaW4gJT4lCiAgY291bnQoc3RhdHVzLCBnZW5kZXIsIGV0aG5pY2l0eSkgJT4lCiAgZ3JvdXBfYnkoc3RhdHVzKSAlPiUgICAgICAgIAogIG11dGF0ZShwcm9wID0gcHJvcC50YWJsZShuKSkKYGBgCgpgYGAKIyBBIHRpYmJsZTogMTIgw5cgNQojIEdyb3VwczogICBzdGF0dXMgWzJdCiAgIHN0YXR1cyBnZW5kZXIgZXRobmljaXR5ICAgICAgICAgICAgICAgICAgbiAgICBwcm9wCiAgIDxjaHI+ICA8Y2hyPiAgPGNocj4gICAgICAgICAgICAgICAgICA8aW50PiAgIDxkYmw+CiAxIEFsaXZlICBmZW1hbGUgaGlzcGFuaWMgb3IgbGF0aW5vICAgICAgICA3NSAwLjAyNDAgCiAyIEFsaXZlICBmZW1hbGUgbm90IGhpc3BhbmljIG9yIGxhdGlubyAgMTM2NyAwLjQzOCAgCiAzIEFsaXZlICBmZW1hbGUgbm90IHJlcG9ydGVkICAgICAgICAgICAgIDMyOCAwLjEwNSAgCiA0IEFsaXZlICBtYWxlICAgaGlzcGFuaWMgb3IgbGF0aW5vICAgICAgICAzNCAwLjAxMDkgCiA1IEFsaXZlICBtYWxlICAgbm90IGhpc3BhbmljIG9yIGxhdGlubyAgMTA0MSAwLjMzNCAgCiA2IEFsaXZlICBtYWxlICAgbm90IHJlcG9ydGVkICAgICAgICAgICAgIDI3NiAwLjA4ODQgCiA3IERlYWQgICBmZW1hbGUgaGlzcGFuaWMgb3IgbGF0aW5vICAgICAgICAgNyAwLjAwODA5CiA4IERlYWQgICBmZW1hbGUgbm90IGhpc3BhbmljIG9yIGxhdGlubyAgIDM3NyAwLjQzNiAgCiA5IERlYWQgICBmZW1hbGUgbm90IHJlcG9ydGVkICAgICAgICAgICAgICA2NCAwLjA3NDAgCjEwIERlYWQgICBtYWxlICAgaGlzcGFuaWMgb3IgbGF0aW5vICAgICAgICAxMCAwLjAxMTYgCjExIERlYWQgICBtYWxlICAgbm90IGhpc3BhbmljIG9yIGxhdGlubyAgIDMyNyAwLjM3OCAgCjEyIERlYWQgICBtYWxlICAgbm90IHJlcG9ydGVkICAgICAgICAgICAgICA4MCAwLjA5MjUgCmBgYAoKYGBge3J9CiMgY2Vuc29yaW5nIHBsb3QgYnkgY2FuY2VyIHR5cGVzCmNsaW4gJT4lCiAgbXV0YXRlKGluZGV4PTE6bigpKSAlPiUKICBnZ3Bsb3QoCiAgICBhZXMoeSA9IGluZGV4LCB4ID0gdGltZSwgY29sb3VyID0gcHJvamVjdCwgc2hhcGUgPSBmYWN0b3Ioc3RhdHVzKSkpICsKICAgIGdlb21fc2VnbWVudChhZXMoeCA9IHRpbWUsIHkgPSBpbmRleCwgeGVuZCA9IDAsIHllbmQgPSBpbmRleCkpICsKICBnZW9tX3BvaW50KCkgKwogIGdndGl0bGUoIiIpICsKICBsYWJzKHg9IlllYXJzIiwgeT0iUGF0aWVudHMiKSArCiAgc2NhbGVfc2hhcGVfZGlzY3JldGUobmFtZSA9ICJTdGF0dXMiLCBsYWJlbHMgPSBjKCJDZW5zb3JlZCIsIkRlYWQiKSkgKwogIHNjYWxlX2NvbG9yX2Rpc2NyZXRlKG5hbWUgPSAiQ2FuY2VyIiwgCiAgICAgICAgICAgICAgICAgICAgICAgbGFiZWxzID0gYygiQmxhZGRlciIsIkJyZWFzdCIsIkNvbG9uIiwiTGl2ZXIiLCAiTHVuZyBhZGVubyIsIAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIlBhbmNyZWF0aWMiLCAiUHJvc3RhdGUiLCJUaHlyb2lkIikpICsKICB0aGVtZShsZWdlbmQucG9zaXRpb249InRvcCIsIGxlZ2VuZC5kaXJlY3Rpb249InZlcnRpY2FsIikgKyAKICBndWlkZXMoY29sb3IgPSBndWlkZV9sZWdlbmQobnJvdyA9IDIsIGJ5cm93ID0gVFJVRSkpCmBgYAoKIVtfT3ZlcmFsbCBzdXJ2aXZhbCB0aW1lcyBhbmQgc3RhdHVzIG9mIHBhbi1jYW5jZXIgcGF0aWVudHMgZnJvbSBUQ0dBLl9dKGZpZy9UQ0dBX3N1cnZpdmFsLnBuZyl7d2lkdGg9NjAlfQoKIyBUQ0dBIG9taWNzIGRhdGEgey19CgpXZSB1c2UgZnVuY3Rpb24gYEdEQ3F1ZXJ5KClgIHRvIHF1ZXJ5IGFuZCB1c2UgYEdEQ2Rvd25sb2FkKClgIGFuZCBgR0RDcHJlcGFyZSgpYCB0byBkb3dubG9hZCBUQ0dBIG9taWNzIGRhdGEgZnJvbSBvbmUgY2FuY2VyIHR5cGUgKGJyZWFzdCBjYW5jZXIpLgpUaGUgYXJndW1lbnQgYGRhdGEuY2F0ZWdvcnlgIGluIGZ1bmN0aW9uIGBHRENxdWVyeSgpYCBzcGVjaWZpZXMgdGhlIHR5cGUgb2Ygb21pY3MgZGF0YSwgc3VjaCBhcyBgIkNvcHkgTnVtYmVyIFZhcmlhdGlvbiJgLCBgIkROQSBNZXRoeWxhdGlvbiJgLCBgIlRyYW5zY3JpcHRvbWUgUHJvZmlsaW5nImAsIGAiU2ltcGxlIE51Y2xlb3RpZGUgVmFyaWF0aW9uImAuCk5vdGUgdGhhdCB0aGUgZG93bmxvYWRlZCBvbWljcyBkYXRhIGFyZSBhY2NvbXBhbmllZCBieSBtZXRhZGF0YSBpbmNsdWRpbmcgc3Vydml2YWwgb3V0Y29tZXMsIGNsaW5pY2FsIGFuZCBkZW1vZ3JhcGhpYyB2YXJpYWJsZXMuIApUaGUgYWNjb21wYW5pZWQgbWV0YWRhdGEgYXJlIGFsbW9zdCB0aGUgc2FtZSBhcyB0aGUgY2xpbmljYWwgZGF0YSBkb3dubG9hZGVkIHZpYSBgR0RDcXVlcnlfY2xpbmljKClgIGluIHRoZSBwcmV2aW91cyBzZWN0aW9uIGJ1dCBoZXJlIG9ubHkgY29ycmVzcG9uZGluZyB0byBvbmUgY2FuY2VyIHR5cGUuCgpgYGB7cn0KIyBkb3dubG9hZCBUQ0dBIGJyZWFzdCBjYW5jZXIgKEJSQ0EpIG1STkEtU2VxIGRhdGEgdXNpbmcgR0RDIGFwaSBtZXRob2QKcXVlcnkgPSBUQ0dBYmlvbGlua3M6OkdEQ3F1ZXJ5KHByb2plY3QgPSAiVENHQS1CUkNBIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGRhdGEuY2F0ZWdvcnkgPSAiVHJhbnNjcmlwdG9tZSBQcm9maWxpbmciLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgZGF0YS50eXBlID0gIkdlbmUgRXhwcmVzc2lvbiBRdWFudGlmaWNhdGlvbiIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICB3b3JrZmxvdy50eXBlID0gIlNUQVIgLSBDb3VudHMiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgZXhwZXJpbWVudGFsLnN0cmF0ZWd5ID0gIlJOQS1TZXEiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgc2FtcGxlLnR5cGUgPSBjKCJQcmltYXJ5IFR1bW9yIikpClRDR0FiaW9saW5rczo6R0RDZG93bmxvYWQocXVlcnkgPSBxdWVyeSwgbWV0aG9kID0gImFwaSIpCmRhdCA9IFRDR0FiaW9saW5rczo6R0RDcHJlcGFyZShxdWVyeSA9IHF1ZXJ5KQoKU3VtbWFyaXplZEV4cGVyaW1lbnQ6OmFzc2F5cyhkYXQpJHVuc3RyYW5kZWRbMTo1LCAxOjJdCmBgYApgYGAKICAgICAgICAgICAgICAgICAgIFRDR0EtTEwtQTczWS0wMUEtMTFSLUEzM0otMDcgVENHQS1FMi1BMUlVLTAxQS0xMVItQTE0RC0wNwpFTlNHMDAwMDAwMDAwMDMuMTUgICAgICAgICAgICAgICAgICAgICAgICAgNzAxNSAgICAgICAgICAgICAgICAgICAgICAgICAgODUwCkVOU0cwMDAwMDAwMDAwNS42ICAgICAgICAgICAgICAgICAgICAgICAgICAgIDE2ICAgICAgICAgICAgICAgICAgICAgICAgICAgIDUKRU5TRzAwMDAwMDAwNDE5LjEzICAgICAgICAgICAgICAgICAgICAgICAgIDIxNjcgICAgICAgICAgICAgICAgICAgICAgICAgMTY4MApFTlNHMDAwMDAwMDA0NTcuMTQgICAgICAgICAgICAgICAgICAgICAgICAgMjUwNSAgICAgICAgICAgICAgICAgICAgICAgICAxNTU5CkVOU0cwMDAwMDAwMDQ2MC4xNyAgICAgICAgICAgICAgICAgICAgICAgICAgNzI2ICAgICAgICAgICAgICAgICAgICAgICAgICA0MDIKYGBgCgpJdCBpcyByZWNvbW1lbmRlZCB0byB1c2UgREVTZXEyIG9yIFRNTSBub3JtYWxpemF0aW9uIG1ldGhvZCBmb3IgUk5BLXNlcSBkYXRhIGJlZm9yZSBmdXJ0aGVyIHN0YXRpc3RpY2FsIGFuYWx5c2lzIFtAWmhhb1kyMDIxXS4KSGVyZSB3ZSBkZW1vbnN0cmF0ZSBob3cgdG8gdXNlIHRoZSBSL0Jpb2NvbmR1Y3RvciBwYWNrYWdlIFsqKkRFU2VxMioqXShodHRwczovL2Jpb2NvbmR1Y3Rvci5vcmcvcGFja2FnZXMvREVTZXEyLykgW0BMb3ZlMjAxNF0gdG8gbm9ybWFsaXplIHRoZSBSTkEgY291bnQgZGF0YS4KCmBgYHtyfQptZXRhID0gY29sRGF0YShkYXQpWywgYygicHJvamVjdF9pZCIsICJzdWJtaXR0ZXJfaWQiLCAiYWdlX2F0X2RpYWdub3NpcyIsICAiZXRobmljaXR5IiwgImdlbmRlciIsICJkYXlzX3RvX2RlYXRoIiwgImRheXNfdG9fbGFzdF9mb2xsb3dfdXAiLCAidml0YWxfc3RhdHVzIiwgInBhcGVyX0JSQ0FfU3VidHlwZV9QQU01MCIpXQpkZHMgPSBERVNlcTI6OkRFU2VxRGF0YVNldEZyb21NYXRyaXgoYXNzYXlzKGRhdCkkdW5zdHJhbmRlZCwgY29sRGF0YSA9IG1ldGEsIGRlc2lnbiA9IH4gMSkgCmRkczIgPSBERVNlcTI6OmVzdGltYXRlU2l6ZUZhY3RvcnMoZGRzKQpSTkFfY291bnQgPSBERVNlcTI6OmNvdW50cyhkZHMyLCBub3JtYWxpemVkPVRSVUUpClJOQV9jb3VudFsxOjUsIDE6Ml0KYGBgCgpgYGAKICAgICAgICAgICAgICAgICAgIFRDR0EtTEwtQTczWS0wMUEtMTFSLUEzM0otMDcgVENHQS1FMi1BMUlVLTAxQS0xMVItQTE0RC0wNwpFTlNHMDAwMDAwMDAwMDMuMTUgICAgICAgICAgICAgICAgICAgNjAzNC4yNzE2OCAgICAgICAgICAgICAgICAgICA5NTEuODI1NzY0CkVOU0cwMDAwMDAwMDAwNS42ICAgICAgICAgICAgICAgICAgICAgIDEzLjc2MzEzICAgICAgICAgICAgICAgICAgICAgNS41OTg5NzUKRU5TRzAwMDAwMDAwNDE5LjEzICAgICAgICAgICAgICAgICAgIDE4NjQuMDQzNzMgICAgICAgICAgICAgICAgICAxODgxLjI1NTYyOApFTlNHMDAwMDAwMDA0NTcuMTQgICAgICAgICAgICAgICAgICAgMjE1NC43ODk4MiAgICAgICAgICAgICAgICAgIDE3NDUuNzYwNDMxCkVOU0cwMDAwMDAwMDQ2MC4xNyAgICAgICAgICAgICAgICAgICAgNjI0LjUwMTk2ICAgICAgICAgICAgICAgICAgIDQ1MC4xNTc1OTcKYGBgCgpUbyBwZXJmb3JtIHN1cnZpdmFsIGFuYWx5c2lzIHdpdGggYm90aCBjbGluaWNhbC9kZW1vZ3JhcGhpYyB2YXJpYWJsZXMgYW5kIG9taWNzIGRhdGEsIGluIHRoZSBmb2xsb3dpbmcgY29kZSB3ZSBleHRyYWN0IGZlbWFsZSBicmVhc3QgY2FuY2VyIHBhdGllbnRzIHdpdGggdGhlaXIgY29ycmVzcG9uZGluZyBzdXJ2aXZhbCBvdXRjb21lcywgY2xpbmljYWwvZGVtb2dyYXBoaWMgdmFyaWFibGVzIGFuZCBSTkEtc2VxIGZlYXR1cmVzLgoKYGBge3J9Cm1ldGEkdGltZSA9IGFwcGx5KG1ldGFbLCBjKCJkYXlzX3RvX2RlYXRoIiwgImRheXNfdG9fbGFzdF9mb2xsb3dfdXAiKV0sIDEsIG1heCwgbmEucm0gPSBUUlVFKSAvIDM2NS4yNQptZXRhJHN0YXR1cyA9IG1ldGEkdml0YWxfc3RhdHVzCm1ldGEkYWdlID0gbWV0YSRhZ2VfYXRfZGlhZ25vc2lzIC8gMzY1LjI1CmNsaW4gPSBzdWJzZXQobWV0YSwgZ2VuZGVyID09ICJmZW1hbGUiICYgIWR1cGxpY2F0ZWQoc3VibWl0dGVyX2lkKSAmIHRpbWUgPiAwICYgIWlzLm5hKGFnZSkpCmNsaW4gPSBjbGluW29yZGVyKGNsaW4kc3VibWl0dGVyX2lkKSwgXQpSTkFfY291bnQgPSBSTkFfY291bnRbLCByb3duYW1lcyhjbGluKV0KYGBgCgo6Ojp7LmluZm8tYm94IC5ub3RlfQpUaGUgUi9CaW9jb25kdWN0b3IgcGFja2FnZSAqKlRDR0FiaW9saW5rcyoqIGNhbm5vdCByZXRyaWV2ZSBhbnkgcHJvdGVvbWljcyBvciBtZXRhYm9sb21pY3MgZGF0YS4KSXQgaXMgYWx3YXlzIHVzZWZ1bCB0byBsb29rIGF0IHlvdXIgZGF0YSBmaXJzdCwgaW4gcGFydGljdWxhciB0aGUgZGF0YSB0eXBlIGFuZCBkaW1lbnNpb25zIChpLmUuIG51bWJlcnMgb2Ygcm93cyBhbmQgY29sdW1ucyBmb3IgYSBkYXRhIGZyYW1lIG9yIG1hdHJpeCkuCjo6OgoKIyBVbml2YXJpYXRlIGFuYWx5c2lzIHstfQoKIyMgTm9ucGFyYW1ldHJpYyBzdXJ2aXZhbCBhbmFseXNpcyB7LX0KCkZvciB0aGUgZGF0YSBvZiBUQ0dBIGJyZWFzdCBjYW5jZXIgcGF0aWVudHMgdGhhdCB3ZSBleHRyYWN0ZWQgaW4gdGhlIHByZXZpb3VzIHNlY3Rpb24sIEthcGxhbi1NZWllciBlc3RpbWF0ZXMgb2YgdGhlIHN1cnZpdmFsIHByb2JhYmlsaXRpZXMgY2FuIGJlIG9idGFpbmVkIHZpYSBmdW5jdGlvbiBgc3VydmZpdCgpYCBmcm9tIFsqKnN1cnZpdmFsKipdKGh0dHBzOi8vQ1JBTi5SLXByb2plY3Qub3JnL3BhY2thZ2U9c3Vydml2YWwpIHBhY2thZ2UuClRoZSBkYXNoZWQgbGluZXMgaW4gdGhlIGZvbGxvd2luZyBmaWd1cmUgaW5kaWNhdGUgdGhlIG1lZGlhbiBzdXJ2aXZhbCB0aW1lLgoKYGBge3J9CiMgS2FwbGFuLU1laWVyIChLTSkgZXN0aW1hdGlvbgpjbGluJHN0YXR1c1tjbGluJHN0YXR1cyA9PSAiRGVhZCJdID0gMQpjbGluJHN0YXR1c1tjbGluJHN0YXR1cyA9PSAiQWxpdmUiXSA9IDAKY2xpbiRzdGF0dXMgPSBhcy5udW1lcmljKGNsaW4kc3RhdHVzKQpzZml0ID0gc3Vydml2YWw6OnN1cnZmaXQoU3Vydih0aW1lLCBzdGF0dXMpIH4gMSwgZGF0YSA9IGNsaW4pCgojIGNhbGN1bGF0ZSBzdXJ2aXZhbCBwcm9iYWJpbGl0eSBhdCAxLSwgMy0gYW5kIDUteWVhciB0aW1lIHBvaW50cwpzdW1tYXJ5KHNmaXQsIHRpbWVzPWMoMSwzLDUpKQp0aGVtZV9zZXQodGhlbWVfYncoKSkKc3Vydm1pbmVyOjpnZ3N1cnZwbG90KHNmaXQsIGNvbmYuaW50ID0gVFJVRSwgcmlzay50YWJsZSA9IFRSVUUsIAogICAgICAgICAgICAgICAgICAgICAgeGxhYiA9ICJUaW1lIHNpbmNlIGRpYWdub3NpcyAoeWVhcikiLGxlZ2VuZCA9ICJub25lIiwKICAgICAgICAgICAgICAgICAgICAgIHN1cnYubWVkaWFuLmxpbmUgPSAiaHYiKQpgYGAKIVtfS2FwbGFuLU1laWVyIGN1cnZlIGZvciAxMDYxIEJSQ0EgcGF0aWVudHMgZGF0YSBmcm9tIFRDR0EuX10oZmlnL1RDR0Ffc3Vydl9rbTEucG5nKXt3aWR0aD02MCV9CgpUbyBjb21wYXJlIHRoZSBzdXJ2aXZhbCBjdXJ2ZXMgb2YgdHdvIGdyb3VwcyBvZiBwYXRpZW50cywgZm9yIGV4YW1wbGUsIGFnZSQ8NjAkIHZzIGFnZSRcZ2UgNjAkLCB0aGUgYFJgIGZ1bmN0aW9uIGBzdXJ2aXZhbDo6c3VydmRpZmYoKWAgY2FuIHBlcmZvcm0gdGhlIGxvZy1yYW5rIHRlc3QgdG8gY29tcGFyZSB0d28gc3Vydml2YWwgY3VydmVzLgpBbHRlcm5hdGl2ZWx5LCB0aGUgYFJgIGZ1bmN0aW9uIGBzdXJ2aXZhbDo6c3VydmZpdGAgd2l0aCBhIGZvcm11bGEgaW5jbHVkaW5nIHRoZSBhZ2UgZ3JvdXAgYXMgYSBjb3ZhcmlhdGUgY2FuIHJldHVybiB0aGUgKEtNKSBzdXJ2aXZhbCBwcm9iYWJpbGl0aWVzIGZvciBlYWNoIGdyb3Vwcy4gClRoZW4gdGhlIGBSYCBmdW5jdGlvbiBgc3Vydm1pbmVyOjpnZ3N1cnZwbG90KClgIHdpdGggYSBgc3VydmZpdGAgb2JqZWN0IHdpbGwgZHJhdyB0aGUgdHdvIHN1cnZpdmFsIGN1cnZlcyBhbmQgcGVyZm9ybSB0aGUgbG9nLXJhbmsgdGVzdCBhcyBzaG93biBpbiB0aGUgZm9sbG93aW5nIGZpZ3VyZS4KCmBgYHtyfQpjbGluJGFnZTIgPSBjbGluJGFnZQpjbGluJGFnZTJbY2xpbiRhZ2UyIDwgNjBdID0gMApjbGluJGFnZTJbY2xpbiRhZ2UyID49IDYwXSA9IDEKc3Vydml2YWw6OnN1cnZkaWZmKFN1cnYodGltZSwgc3RhdHVzKSB+IGFnZTIsIGRhdGEgPSBjbGluKQoKc2ZpdDIgPSBzdXJ2Zml0KFN1cnYodGltZSwgc3RhdHVzKSB+IGFnZTIsIGRhdGEgPSBjbGluKQpnZ3N1cnYgPSBnZ3N1cnZwbG90KHNmaXQyLCBjb25mLmludCA9IFRSVUUsIHJpc2sudGFibGUgPSBUUlVFLCAKICAgICAgICAgICB4bGFiID0gIlRpbWUgc2luY2UgZGlhZ25vc2lzICh5ZWFyKSIsIGxlZ2VuZCA9IGMoLjgsLjkpLAogICAgICAgICAgIGxlZ2VuZC5sYWJzID0gYygiPDYwIiwgIj49NjAiKSwgbGVnZW5kLnRpdGxlID0gIkFnZSIsICAKICAgICAgICAgICByaXNrLnRhYmxlLnkudGV4dC5jb2wgPSBUUlVFLCByaXNrLnRhYmxlLnkudGV4dCA9IEZBTFNFKQpnZ3N1cnYkcGxvdCA9IGdnc3VydiRwbG90ICsgCiAgYW5ub3RhdGUoInRleHQiLCB4ID0gMjIsIHkgPSAuNzIsIGxhYmVsPSBwYXN0ZTAoIkxvZy1yYW5rIHRlc3Q6XG4iLCBzdXJ2X3B2YWx1ZShzZml0MikkcHZhbC50eHQpKQpnZ3N1cnYKYGBgCiFbX0thcGxhbi1NZWllciBjdXJ2ZXMgb2YgdGhlIEJSQ0EgcGF0aWVudHMnIHN1cnZpdmFsIGRhdGEgZnJvbSBUQ0dBIGdyb3VwZWQgYnkgYWdlICQ8NjAkIGFuZCAkXGdlIDYwJC4gVGhlIGxvZy1yYW5rIHRlc3QgaXMgdG8gY29tcGFyZSB0aGUgdHdvIHN1cnZpdmFsIGRpc3RyaWJ1dGlvbnMgY29ycmVzcG9uZGluZyB0byB0aGUgdHdvIGdyb3VwcyBvZiBwYXRpZW50cy5fXShmaWcvVENHQV9zdXJ2X2ttMi5wbmcpe3dpZHRoPTYwJX0KClRvIGFuYWx5emUgaWYgYSBjb250aW51b3VzIHZhcmlhYmxlLCBlLmcuIGFnZSwgaXMgYXNzb2NpYXRlZCB3aXRoIHRoZSBzdXJ2aXZhbCBvdXRjb21lcywgd2UgY2FuIHVzZSB0aGUgYFJgIGZ1bmN0aW9uIGBjb3hwaCgpYCBmb3IgZml0dGluZyBhIENveCBtb2RlbCwgd2hpY2ggaXMgc2ltaWxhciB0byB0aGUgZnVuY3Rpb24gYGxtKClgIGZvciBmaXR0aW5nIGxpbmVhciBtb2RlbHMuCgpgYGB7cn0KZml0X2NveCA9IGNveHBoKFN1cnYodGltZSwgc3RhdHVzKSB+IGFnZSwgZGF0YSA9IGNsaW4pCnN1bW1hcnkoZml0X2NveCkKYGBgCmBgYApDYWxsOgpjb3hwaChmb3JtdWxhID0gU3Vydih0aW1lLCBzdGF0dXMpIH4gYWdlLCBkYXRhID0gY2xpbikKCiAgbj0gMTA0NywgbnVtYmVyIG9mIGV2ZW50cz0gMTQ5IAogICAoMTQgb2JzZXJ2YXRpb25zIGRlbGV0ZWQgZHVlIHRvIG1pc3NpbmduZXNzKQoKICAgICAgICBjb2VmIGV4cChjb2VmKSBzZShjb2VmKSAgICAgeiBQcig+fHp8KSAgICAKYWdlIDAuMDM0MjQ0ICAxLjAzNDgzNyAwLjAwNjcwMyA1LjEwOSAzLjI0ZS0wNyAqKioKLS0tClNpZ25pZi4gY29kZXM6ICAwIOKAmCoqKuKAmSAwLjAwMSDigJgqKuKAmSAwLjAxIOKAmCrigJkgMC4wNSDigJgu4oCZIDAuMSDigJgg4oCZIDEKCiAgICBleHAoY29lZikgZXhwKC1jb2VmKSBsb3dlciAuOTUgdXBwZXIgLjk1CmFnZSAgICAgMS4wMzUgICAgIDAuOTY2MyAgICAgMS4wMjEgICAgIDEuMDQ5CgpDb25jb3JkYW5jZT0gMC42MzkgIChzZSA9IDAuMDI5ICkKTGlrZWxpaG9vZCByYXRpbyB0ZXN0PSAyNi4zNCAgb24gMSBkZiwgICBwPTNlLTA3CldhbGQgdGVzdCAgICAgICAgICAgID0gMjYuMSAgb24gMSBkZiwgICBwPTNlLTA3ClNjb3JlIChsb2dyYW5rKSB0ZXN0ID0gMjYuNjMgIG9uIDEgZGYsICAgcD0yZS0wNwpgYGAKClRoZSBDb3ggbW9kZWwgYXNzdW1lcyBwcm9wb3J0aW9uYWwgaGF6YXJkcyBhbmQgbG9nLWxpbmVhcml0eSBvZiB0aGUgY292YXJpYXRlcy4KVG8gY2hlY2sgdGhlIGxvZy1saW5lYXJpdHkgZm9yIGEgY2xpbmljYWwgb3IgZGVtb2dyYXBoaWMgdmFyaWFibGUsIGUuZy4gYWdlLCB3ZSBjYW4gZml0IGEgcGVuYWxpemVkIHNtb290aGluZyBzcGxpbmUgZm9yIGFnZSBlZmZlY3QuClRoZSBmb2xsb3dpbmcgY29kZSBzaG93cyB0aGF0IHRoZSBub25saW5lYXIgcGFydCBvZiB0aGUgc21vb3RoaW5nIHNwbGluZSBkb2VzIG5vdCBoYXZlIGEgc2lnbmlmaWNhbnQgZWZmZWN0ICgkcCA9IDAuMDAwMTMkKS4KVGh1cywgdGhlIGFzc3VtcHRpb24gb2YgbG9nLWxpbmVhcml0eSBmb3IgYWdlIGlzIG5vdCBzYXRpc2ZpZWQuCgpgYGB7cn0KZml0X2NveF9zcGxpbmUgPSBjb3hwaChTdXJ2KHRpbWUsIHN0YXR1cykgfiBwc3BsaW5lKGFnZSksIGRhdGEgPSBjbGluKQpmaXRfY294X3NwbGluZQpgYGAKYGBgCkNhbGw6CmNveHBoKGZvcm11bGEgPSBTdXJ2KHRpbWUsIHN0YXR1cykgfiBwc3BsaW5lKGFnZSksIGRhdGEgPSBjbGluKQoKICAgICAgICAgICAgICAgICAgICAgICAgIGNvZWYgc2UoY29lZikgICAgICBzZTIgICAgQ2hpc3EgICBERiAgICAgICBwCnBzcGxpbmUoYWdlKSwgbGluZWFyICAwLjAzNTA5ICAwLjAwNTc3ICAwLjAwNTc3IDM2Ljk4MzIzIDEuMDAgMS4yZS0wOQpwc3BsaW5lKGFnZSksIG5vbmxpbiAgICAgICAgICAgICAgICAgICAgICAgICAgICAyMC42OTE0NiAzLjAzIDAuMDAwMTMKCkl0ZXJhdGlvbnM6IDUgb3V0ZXIsIDE1IE5ld3Rvbi1SYXBoc29uCiAgICAgVGhldGE9IDAuODI4IApEZWdyZWVzIG9mIGZyZWVkb20gZm9yIHRlcm1zPSA0IApMaWtlbGlob29kIHJhdGlvIHRlc3Q9NDYuNCAgb24gNC4wMyBkZiwgcD0yZS0wOQpuPSAxMDQ3LCBudW1iZXIgb2YgZXZlbnRzPSAxNDkgCiAgICgxNCBvYnNlcnZhdGlvbnMgZGVsZXRlZCBkdWUgdG8gbWlzc2luZ25lc3MpCmBgYAoKVG8gY2hlY2sgcHJvcG9ydGlvbmFsIGhhemFyZHMgb2YgYWdlLCB3ZSBjYW4gYWRkIGEgdGltZS1kZXBlbmRlbnQgY292YXJpYXRlICRhZ2UgXHRpbWVzIGcodCkkLCB3aGVyZSAkZyh0KSQgaXMgYSBrbm93biBmdW5jdGlvbiBlLmcuICRnKHQpID0gXGxvZyB0JC4KVGhlIGZvbGxvd2luZyBjb2RlIHNob3dzIHRoYXQgdGhlIHRpbWUtZGVwZW5kZW50IGFnZSBpcyBzaWduaWZpY2FudCB1c2luZyBhIHNjb3JlIHRlc3QgKCRwID0gMC4wMDg3JCkuClRodXMsIHRoZSBhc3N1bXB0aW9uIG9mIHByb3BvcnRpb25hbCBoYXphcmRzIGZvciBhZ2UgaXMgbm90IHNhdGlzZmllZC4gVGhlIGFib3ZlIHR3byB0ZXN0cyBpbmRpY2F0ZSBhIG5vbi1sb2dsaW5lYXIgb3IgdGltZS1kZXBlbmRlbnQgYXNzb2NpYXRpb24gb2YgYWdlIHdpdGggdGhlIHN1cnZpdmFsIG91dGNvbWVzLgoKYGBge3J9CnN1cnZpdmFsOjpjb3guenBoKGZpdF9jb3gsIHRyYW5zZm9ybSA9ICJsb2ciKSAKYGBgCmBgYAogICAgICAgY2hpc3EgZGYgICAgcAphZ2UgICAgIDYuODggIDEgMC4wMDg3CkdMT0JBTCAgNi44OCAgMSAwLjAwODcKYGBgCjo6OnsuaW5mby1ib3ggLm5vdGV9CkhlcmUgdGhlIGFwcHJvYWNoZXMgZm9yIGNoZWNraW5nIGxvZy1saW5lYXJpdHkgb3IgcHJvcG9ydGlvbmFsIGhhemFyZHMgY2FuIG9ubHkgYmUgdXNlZCBpbiBsb3ctZGltZW5zaW9uYWwgZGF0YSBzZXR0aW5ncy4KV2hlbiBpbmNsdWRpbmcgaGlnaC1kaW1lbnNpb25hbCBvbWljcyBkYXRhLCB0aGVyZSBhcmUgbm8gc3RhbmRhcmQgYXBwcm9hY2hlcyBmb3IgY2hlY2tpbmcgbG9nLWxpbmVhcml0eSBvciBwcm9wb3J0aW9uYWwgaGF6YXJkcyBjdXJyZW50bHkuCjo6OgoKIyMgRmVhdHVyZSBwcmVzZWxlY3Rpb24vZmlsdGVyaW5nIHstfQoKRnJvbSBhIHByYWN0aWNhbCBwb2ludCBvZiB2aWV3LCBzaW5jZSBtb3N0IG9taWNzIHByb2ZpbGVzIGNvbnRhaW4gdGhvdXNhbmRzIG9mIHZhcmlhYmxlcyBhbmQgbW9zdCBzdXBlcnZpc2VkIHN0YXRpc3RpY2FsIG1ldGhvZHMgYXJlIG5vdCBzdWl0ZWQgZm9yIGhpZ2ggZGltZW5zaW9uYWwgb21pY3MgZmVhdHVyZXMsIGl0IGlzIGJldHRlciB0byBmaWx0ZXIgdGhlIG9taWNzIGZlYXR1cmVzIGZpcnN0LgpJbiBhZGRpdGlvbiwgd2UgcGVyY2VpdmUgdGhhdCBub3QgdG9vIG1hbnkgb21pY3MgZmVhdHVyZXMgYXJlIHJlbGV2YW50IHRvIG9uZSBtZWRpY2FsIHByb2JsZW0uCldlIHdpbGwgZGVtb25zdHJhdGUgKip0d28gZGlmZmVyZW50IGZpbHRlcmluZyBhcHByb2FjaGVzIGZvciBoaWdoLWRpbWVuc2lvbmFsIG9taWNzIGRhdGEqKjoKCi0gVW5pdmFyaWF0ZSBwLXZhbHVlLWJhc2VkIGZpbHRlcmluZwotIFVuaXZhcmlhdGUgdmFyaWFuY2UtYmFzZWQgZmlsdGVyaW5nCgojIyMgUC12YWx1ZSBmaWx0ZXIgey19CgpCZWZvcmUgam9pbnQgYW5hbHl6aW5nIHRoZSBhc3NvY2lhdGlvbnMgYmV0d2VlbiB0aGUgdGhvdXNhbmRzIG9mIG9taWNzIGZlYXR1cmVzIGFuZCBzdXJ2aXZhbCBvdXRjb21lcywgb25lIGNhbiBhbmFseXplIHRoZSBhc3NvY2lhdGlvbiBiZXR3ZWVuIGVhY2ggb21pY3MgZmVhdHVyZSBhbmQgdGhlIHN1cnZpdmFsIG91dGNvbWVzLCBhbmQgZmlsdGVyIG9taWNzIGZlYXR1cmVzIGF0IGEgc3RhdGlzdGljYWwgc2lnbmlmaWNhbmNlIGxldmVsICQwLjEkIG9yICQwLjIkIChsYXJnZXIgdGhhbiAwLjA1IHRvIHJlZHVjZSBmYWxzZSBuZWdhdGl2ZSBpZGVudGlmaWNhdGlvbiBvZiBvbWljcyBmZWF0dXJlcyBpbiBtdWx0aXZhcmlhdGUgYW5hbHlzaXMpLgpGb3IgZGVtb25zdHJhdGlvbiwgYmFzZWQgb24gdGhlICQxMDAkIG1STkEtU2VxIGZlYXR1cmVzIGZyb20gVENHQSBicmVhc3QgY2FuY2VyIHBhdGllbnRzIHByZXByb2Nlc3NlZCBwcmV2aW91c2x5LCB0aGUgY29kZSBiZWxvdyBmaWx0ZXJzIG9taWNzIGZlYXR1cmVzIGF0IHRoZSBzdGF0aXN0aWNhbCBzaWduaWZpY2FuY2UgbGV2ZWwgJDAuMiQsIGkuZS4gdW5pdmFyaWF0ZSBhbmFseXNpcyAkcCA8IDAuMiQuCgpgYGB7cn0KUk5BX2xvZzJjb3VudCA9IGxvZzIoUk5BX2NvdW50WzE6MTAwLCBdICsgMSkKcHZhbHVlcyA8LSByZXAoTkEsIG5yb3coUk5BX2xvZzJjb3VudCkpCmZvcihqIGluIDE6bnJvdyhSTkFfbG9nMmNvdW50KSkgewogIGZpdF9jb3ggPSBjb3hwaChTdXJ2KGNsaW4kdGltZSwgY2xpbiRzdGF0dXMpIH4gUk5BX2xvZzJjb3VudFtqLCBdLCBkYXRhID0gY2xpbikKICBwdmFsdWVzW2pdID0gc3VtbWFyeShmaXRfY294KSRjb2VmZmljaWVudHNbLCAiUHIoPnx6fCkiXQp9CmZpbHRlcmVkX3JuYSA8LSBSTkFfbG9nMmNvdW50W3doaWNoKHB2YWx1ZXMgPCAwLjIpLCBdCmBgYAoKIyMjIFZhcmlhbmNlIGZpbHRlciB7LX0KClRoZSBvdGhlciBjb21tb24gYW5kIGVhc3kgd2F5IHRvIGRlY3JlYXNlIHRoZSBudW1iZXIgb2Ygb21pY3MgZmVhdHVyZXMgaXMgdG8gZmlsdGVyIHRoZSBtb3N0IHZhcmlhYmxlIG9uZXMgZm9yIGZ1cnRoZXIgYW5hbHlzaXMuCk5vdGUgdGhhdCB0aGUgdmFyaWFuY2UtYmFzZWQgZmlsdGVyaW5nIHN0ZXAgc2hvdWxkIGJlIGRvbmUgYmVmb3JlIGRhdGEgc3RhbmRhcmRpemF0aW9uIChpLmUuIGNhbGN1bGF0aW5nICR6JC1zY29yZSksIGJ1dCBjYW4gYmUgcGVyZm9ybWVkIGFmdGVyIGNvdW50IGRhdGEgbm9ybWFsaXphdGlvbiBhbmQgbG9nMi10cmFuc2Zvcm1hdGlvbiBmb3IgaW5zdGFuY2UuCgpUaGUgYFJgIHBhY2thZ2UgWyoqTTNDKipdKGh0dHBzOi8vYmlvY29uZHVjdG9yLm9yZy9wYWNrYWdlcy9NM0MvKSBbQEpvaG4yMDIwXSBwcm92aWRlcyBhIGZpbHRlciBmdW5jdGlvbiBgZmVhdHVyZWZpbHRlcigpYCBieSB1c2luZyBkaWZmZXJlbnQgdmFyaWFuY2UtdHlwZSBtZXRyaWNzLCBmb3IgZXhhbXBsZSwgdmFyaWFuY2UsIG1lZGlhbiBhYnNvbHV0ZSBkZXZpYXRpb24gKE1BRCksIGNvZWZmaWNpZW50IG9mIHZhcmlhdGlvbiAoQSkgYW5kIGl0cyBzZWNvbmQgb3JkZXIgZGVyaXZhdGl2ZSAoQTIpLgpUaGUgc2ltcGxlIHZhcmlhbmNlIGZpbHRlciBjYW4gYmUgdXNlZCBpZiB0aGUgdmFyaWFuY2UgZG9lcyBub3QgY2hhbmdlIHdpdGggdGhlIGNvcnJlc3BvbmRpbmcgbWVhbiwgb3RoZXJ3aXNlIHRoZSBjb2VmZmljaWVudCBvZiB2YXJpYXRpb24gY2FuIGJlIHVzZWQuCklmIHRoZSBvbWljcyBkYXRhIGluY2x1ZGUgb3V0bGllcnMsIE1BRCBmaWx0ZXIgaXMgbW9yZSByb2J1c3QgdGhhbiB0aGUgdmFyaWFuY2UgZmlsdGVyLgpCYXNlZCBvbiB0aGUgJDYwNjYwJCBtUk5BLVNlcSBmZWF0dXJlcyBmcm9tIFRDR0EgYnJlYXN0IGNhbmNlciBwYXRpZW50cyBwcmVwcm9jZXNzZWQgcHJldmlvdXNseSwgdGhlIGNvZGUgYmVsb3cgZXh0cmFjdHMgdGhlICQxXCUkIG1vc3QgdmFyaWFibGUgZmVhdHVyZXMgdXNpbmcgdmFyaWFuY2UgYXMgYSBmaWx0ZXJpbmcgbWV0cmljLgoKYGBge3J9ClJOQV9sb2cyY291bnQgPSBsb2cyKFJOQV9jb3VudCArIDEpCmZpbHRlcmVkID0gTTNDOjpmZWF0dXJlZmlsdGVyKFJOQV9sb2cyY291bnQsIHBlcmNlbnRpbGUgPSAxLCBtZXRob2QgPSAndmFyJywgdG9wTiA9IDUpCmZpbHRlcmVkX3JuYTEgPSBmaWx0ZXJlZCRmaWx0ZXJlZF9kYXRhCmBgYApgYGAKKioqZmVhdHVyZSBmaWx0ZXIgZnVuY3Rpb24qKioKZXh0cmFjdGluZyB0aGUgbW9zdCB2YXJpYWJsZTogMSBwZXJjZW50CmZlYXR1cmVzIHRvIHN0YXJ0IHdpdGg6IDYwNjYwCnBlcmZvcm1pbmcgY2FsY3VsYXRpb25zIGZvciB2YXJpYW5jZQpwcmludGluZyB0b3BOIG1vc3QgdmFyaWFibGUgZmVhdHVyZXMgd2l0aCBzdGF0aXN0aWNzLi4uCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGZlYXR1cmUgICAgICBtZWFuICAgICAgdmFyICAgICAgIHNkCkVOU0cwMDAwMDE2NjUwOS4xMiBFTlNHMDAwMDAxNjY1MDkuMTIgIDYuMDg0MzM2IDMxLjYwNDUwIDUuNjIxNzg4CkVOU0cwMDAwMDExMDQ4NC43ICAgRU5TRzAwMDAwMTEwNDg0LjcgMTEuMDA0MzQ2IDI2LjIyNjg2IDUuMTIxMjE2CkVOU0cwMDAwMDE1MzAwMi4xMiBFTlNHMDAwMDAxNTMwMDIuMTIgIDguMjIyMzg2IDI1Ljg3NzgwIDUuMDg3MDIyCkVOU0cwMDAwMDEzNDE4NC4xMyBFTlNHMDAwMDAxMzQxODQuMTMgIDUuMzcxMTU4IDIzLjI4NzU2IDQuODI1NzE5CkVOU0cwMDAwMDE2MDE4Mi4zICAgRU5TRzAwMDAwMTYwMTgyLjMgIDkuOTAxNTY3IDIxLjQ4NDAzIDQuNjM1MDg3CmZlYXR1cmVzIHJlbWFpbmluZzogNjA3CmBgYAoKQW5vdGhlciB2YXJpYW5jZS10eXBlIGZpbHRlciBpcyB0byByZW1haW4gZmVhdHVyZXMgd2l0aCBjZXJ0YWluIHBlcmNlbnRhZ2Ugb2YgKipjdW11bGF0aXZlIHZhcmlhbmNlcyoqLCB3aGljaCB3aWxsIHVzdWFsbHkgZmlsdGVyIGZld2VyIGZlYXR1cmVzIHRoYW4gdGhlIGFwcHJvYWNoZXMgYWJvdmUuClRoZSBjb2RlIGJlbG93IGV4dHJhY3RzIHRoZSBtb3N0IHZhcmlhYmxlIGZlYXR1cmVzIGV4cGxhaW5pbmcgJDFcJSQgKipjdW11bGF0aXZlIHZhcmlhbmNlcyoqLgoKYGBge3J9CmN1bXN1bV92YXIgPSBjdW1zdW0oZmlsdGVyZWQkc3RhdGlzdGljcyR2YXIpCmN1bXN1bV9jdXRvZmYgPSBjdW1zdW1fdmFyW2xlbmd0aChjdW1zdW1fdmFyKV0gKiAwLjAxCmZpbHRlcmVkX25hbWVzID0gZmlsdGVyZWQkc3RhdGlzdGljcyRmZWF0dXJlW2N1bXN1bV92YXIgPCBjdW1zdW1fY3V0b2ZmXQpgYGAKCiMgTXVsdGl2YXJpYXRlIGFuYWx5c2lzIHstfQoKIyMgVW5zdXBlcnZpc2VkIGxlYXJuaW5nIChvbWljcyBkYXRhKSB7LX0KCkluIHRoaXMgc2VjdGlvbiB3ZSB3aWxsIHVzZSB0aGUgbVJOQS1TZXEgZGF0YSBvZiBicmVhc3QgY2FuY2VyIHBhdGllbnRzIGZyb20gVENHQS4KVGhlIGZvbGxvd2luZyB1bnN1cGVydmlzZWQgbWV0aG9kcyBjYW4gYmUgYXBwbGllZCB0byBvdGhlciBvbWljcyBkYXRhIGFzIHdlbGwgKHRoZSBzYW1lIGFwcGxpZXMgdG8gdGhlIHN1cGVydmlzZWQgbGVhcm5pbmcgbWV0aG9kcykuCk9uZSBpbXBvcnRhbnQgdGhpbmcgaXMgdGhhdCB0aGUgaW5wdXQgb21pY3MgZGF0YSwgZXNwZWNpYWxseSB0aGUgZGF0YSB0eXBlIGFuZCBkaW1lbnNpb25zLCBzaG91bGQgYmUgc3VpdGVkIHRvIHRoZSBtZXRob2RzLgoKVW5zdXBlcnZpc2VkIGxlYXJuaW5nIGZvciBvbWljcyBkYXRhIGNhbiBiZSBoZWxwZnVsIHRvIGV4cGxvcmUgc3VicG9wdWxhdGlvbnMgb2YgdGhlIGRhdGEsIGZvciBleGFtcGxlLCBwYXRpZW50cyBmcm9tIG9uZSBjYW5jZXIgdHlwZSBjYW4gYmUgZGl2aWRlZCB0byBzZXZlcmFsIG9taWNzLXJlbGF0ZWQgc3VidHlwZXMuCldlIGRlbW9uc3RyYXRlIHRocmVlIHVuc3VwZXJ2aXNlZCBsZWFybmluZyBtZXRob2RzLCBpLmUuIHByaW5jaXBhbCBjb21wb25lbnQgYW5hbHlzaXMgKFBDQSksICR0JC1zdG9jaGFzdGljIG5laWdoYm91ciBlbWJlZGRpbmcgKCR0JC1TTkUpIGFuZCB1bmlmb3JtIG1hbmlmb2xkIGFwcHJveGltYXRpb24gYW5kIHByb2plY3Rpb24gKFVNQVApLCBiYXNlZCBvbiB0aGUgUEFNNTAgZ2VuZXMgW0BQYXJrZXIyMDA5XS4KVGhlIGBSYCBwYWNrYWdlIFsqKk0zQyoqXShodHRwczovL2Jpb2NvbmR1Y3Rvci5vcmcvcGFja2FnZXMvTTNDLykgW0BKb2huMjAyMF0gcHJvdmlkZXMgdGhlIGFuYWx5c2VzIGFuZCB2aXN1YWxpemF0aW9uIG9mIGFsbCB0aGUgdGhyZWUgbWV0aG9kcy4KCmBgYHtyfQojIGV4dHJhY3QgdGhlIFBBTTUwIGdlbmVzIG9mIFRDR0EtQlJDQSBwYXRpZW50cwpUQ0dBX1BBTTUwID0gUk5BX2NvdW50W3NhcHBseShzdHJzcGxpdChyb3duYW1lcyhSTkFfY291bnQpLCAiLiIsIGZpeGVkID0gVFJVRSksIGZ1bmN0aW9uKHgpIHhbWzFdXSkgJWluJSBjKAogICJFTlNHMDAwMDAwNzcxNTIiLCAiRU5TRzAwMDAwMDg5Njg1IiwgIkVOU0cwMDAwMDE0MzIyOCIsICJFTlNHMDAwMDAwOTQ4MDQiLCAiRU5TRzAwMDAwMTM0MDU3IiwKICAiRU5TRzAwMDAwMTc2ODkwIiwgIkVOU0cwMDAwMDEwMTA1NyIsICJFTlNHMDAwMDAxMzgxODAiLCAiRU5TRzAwMDAwMTY1MzA0IiwgIkVOU0cwMDAwMDA4MDk4NiIsCiAgIkVOU0cwMDAwMDE3MTg0OCIsICJFTlNHMDAwMDAxNzUwNjMiLCAiRU5TRzAwMDAwMTE3NzI0IiwgIkVOU0cwMDAwMDE2NDYxMSIsICJFTlNHMDAwMDAxNzQzNzEiLAogICJFTlNHMDAwMDAwOTE2NTEiLCAiRU5TRzAwMDAwMDExNDI2IiwgIkVOU0cwMDAwMDEwNTE3MyIsICJFTlNHMDAwMDAxMTczOTkiLCAiRU5TRzAwMDAwMTQ4NzczIiwKICAiRU5TRzAwMDAwMTQyOTQ1IiwgIkVOU0cwMDAwMDEzMzYyNyIsICJFTlNHMDAwMDAxMzY5OTciLCAiRU5TRzAwMDAwMTQ2NjQ4IiwgIkVOU0cwMDAwMDE4NjA4MSIsCiAgIkVOU0cwMDAwMDA5MjYyMSIsICJFTlNHMDAwMDAwNjIwMzgiLCAiRU5TRzAwMDAwMjYxODU3IiwgIkVOU0cwMDAwMDEyODQyMiIsICJFTlNHMDAwMDAwNTQ1OTgiLAogICJFTlNHMDAwMDAxMDQzMzIiLCAiRU5TRzAwMDAwMTg2ODQ3IiwgIkVOU0cwMDAwMDA5MTgzMSIsICJFTlNHMDAwMDAxNDE0MjQiLCAiRU5TRzAwMDAwMTA3MjYyIiwKICAiRU5TRzAwMDAwMTg2ODY4IiwgIkVOU0cwMDAwMDA4MjE3NSIsICJFTlNHMDAwMDAxNzE2MDQiLCAiRU5TRzAwMDAwMTE1NjQ4IiwgIkVOU0cwMDAwMDE3MTc5MSIsCiAgIkVOU0cwMDAwMDEzNTY3OSIsICJFTlNHMDAwMDAxNzE0MjgiLCAiRU5TRzAwMDAwMTI5NTE0IiwgIkVOU0cwMDAwMDEwNjYwNSIsICJFTlNHMDAwMDAwOTk5NTMiLAogICJFTlNHMDAwMDAxNzM4OTAiLCAiRU5TRzAwMDAwMTYwODY3IiwgIkVOU0cwMDAwMDE0MTczOCIsICJFTlNHMDAwMDAxNTE3MTUiLCAiRU5TRzAwMDAwMTQxNzM2IiksIF0KIyB1c2UgZ2VuZSBzeW1ib2xzIGluc3RlYWQgb2YgRW5zZW1ibCBJRHMKcm93bmFtZXMoVENHQV9QQU01MCkgPSAKICBjKCJVQkUyVCIsICJCSVJDNSIsICJOVUYyIiwgIkNEQzYiLCAiQ0NOQjEiLCAiVFlNUyIsICJNWUJMMiIsICJDRVA1NSIsICJNRUxLIiwgIk5EQzgwIiwgIlJSTTIiLCAKICAgICJVQkUyQyIsICJDRU5QRiIsICJQVFRHMSIsICJFWE8xIiwgIk9SQzZMIiwgIkFOTE4iLCAiQ0NORTEiLCAiQ0RDMjAiLCAiTUtJNjciLCAiS0lGMkMiLCAKICAgICJBQ1RSM0IiLCAiTVlDIiwgIkVHRlIiLCAiS1JUNSIsICJQSEdESCIsICJDREgzIiwgIk1JQSIsICJLUlQxNyIsICJGT1hDMSIsICJTRlJQMSIsICJLUlQxNCIsIAogICAgIkVTUjEiLCAiU0xDMzlBNiIsICJCQUcxIiwgIk1BUFQiLCAiUEdSIiwgIkNYWEM1IiwgIk1MUEgiLCAiQkNMMiIsICJNRE0yIiwgIk5BVDEiLCAiRk9YQTEiLCAKICAgICJCTFZSQSIsICJNTVAxMSIsICJHUFIxNjAiLCAiRkdGUjQiLCAiR1JCNyIsICJUTUVNNDVCIiwgIkVSQkIyIikKCiMgbG9nMi10cmFuc2Zvcm1hdGlvbiBvZiB0aGUgbm9ybWFsaXplZCBjb3VudCBkYXRhClRDR0FfUEFNNTAgPSBsb2cyKFRDR0FfUEFNNTAgKyAxKQpwYW01MCA9IGZhY3RvcihjbGluJHBhcGVyX0JSQ0FfU3VidHlwZV9QQU01MCkKCk0zQzo6cGNhKFRDR0FfUEFNNTAsIGxhYmVscyA9IHBhbTUwLCBkb3RzaXplID0gMywgIGxlZ2VuZHRpdGxlID0gIlN1YnR5cGUiKQpgYGAKIVtfVW5zdXBlcnZpc2VkIGNsdXN0ZXJpbmcgKHByaW5jaXBhbCBjb21wb25lbnQgYW5hbHlzaXMsIFBDQSkgb2YgdHJhbnNjcmlwdG9taWMgZGF0YSBmcm9tIFRDR0EgYnJlYXN0IGNhbmNlciBwYXRpZW50c19dKGZpZy9UQ0dBX3BjYS5wbmcpe3dpZHRoPTUwJX0KCmBgYHtyfQpNM0M6OnRzbmUoVENHQV9QQU01MCwgbGFiZWxzID0gcGFtNTAsIGRvdHNpemUgPSAzLCAgbGVnZW5kdGl0bGUgPSAiU3VidHlwZSIpCmBgYAohW19VbnN1cGVydmlzZWQgY2x1c3RlcmluZyAoJHQkLXN0b2NoYXN0aWMgbmVpZ2hib3VyIGVtYmVkZGluZywgJHQkLVNORSkgb2YgdHJhbnNjcmlwdG9taWMgZGF0YSBmcm9tIFRDR0EgYnJlYXN0IGNhbmNlciBwYXRpZW50c19dKGZpZy9UQ0dBX3RzbmUucG5nKXt3aWR0aD01MCV9CgpgYGB7cn0KTTNDOjp1bWFwKFRDR0FfUEFNNTAsIGxhYmVscyA9IHBhbTUwLCBkb3RzaXplID0gMywgIGxlZ2VuZHRpdGxlID0gIlN1YnR5cGUiKQpgYGAKIVtfVW5zdXBlcnZpc2VkIGNsdXN0ZXJpbmcgKHVuaWZvcm0gbWFuaWZvbGQgYXBwcm94aW1hdGlvbiBhbmQgcHJvamVjdGlvbiwgVU1BUCkgb2YgdHJhbnNjcmlwdG9taWMgZGF0YSBmcm9tIFRDR0EgYnJlYXN0IGNhbmNlciBwYXRpZW50c19dKGZpZy9UQ0dBX3VtYXAucG5nKXt3aWR0aD01MCV9CgojIyBTdXBlcnZpc2VkIGxlYXJuaW5nIChvbWljcyBhbmQgc3Vydml2YWwgZGF0YSkgey19CgpUbyBpbnZlc3RpZ2F0ZSB0aGUgcmVsYXRpb25zaGlwIGJldHdlZW4gb21pY3MgZmVhdHVyZXMgYW5kIHN1cnZpdmFsIG91dGNvbWVzLCByZWdyZXNzaW9uIG1ldGhvZHMgKGkuZS4gc3VwZXJ2aXNlZCBsZWFybmluZykgY2FuIGJlIGFwcGxpZWQuIApTaW5jZSBvbWljcyBkYXRhIGFyZSBoaWdoLWRpbWVuc2lvbmFsLCBvbmUgY2FuIHVzZSB1bnN1cGVydmlzZWQgbGVhcm5pbmcgbWV0aG9kcyB0byBzdW1tYXJpemUgYSBmZXcgY29tcG9uZW50cyAoZGltZW5zaW9uIHJlZHVjdGlvbikgYW5kIHJlZ3Jlc3MgdGhlIHN1cnZpdmFsIG91dGNvbWVzIG9uIHRoZSBsb3ctZGltZW5zaW9uYWwgY29tcG9uZW50cyBieSBzb21lIGNsYXNzaWNhbCBzdGF0aXN0aWNhbCBtZXRob2RzLCBlLmcuIGNsYXNzaWNhbCBDb3ggbW9kZWwuClRoZXJlIGFyZSBhbHNvIGZyZXF1ZW50aXN0IGFuZCBCYXllc2lhbiBzdXBlcnZpc2VkIGxlYXJuaW5nIG1ldGhvZHMgc3VpdGVkIHRvIGRpcmVjdGx5IHJlZ3Jlc3MgdGhlIHN1cnZpdmFsIG91dGNvbWVzIG9uIHRoZSBoaWdoLWRpbWVuc2lvbmFsIG9taWNzIGZlYXR1cmVzLgpOb3RlIHRoYXQgcHJlc2VsZWN0aW5nL2ZpbHRlcmluZyB1bHRyYWhpZ2gtZGltZW5zaW9uYWwgb21pY3MgZmVhdHVyZXMgY2FuIGJlIHVzZWZ1bCBiZWZvcmUgcnVubmluZyB0aGUgZnJlcXVlbnRpc3QgYW5kIEJheWVzaWFuIHN1cGVydmlzZWQgbGVhcm5pbmcgbWV0aG9kcy4KCiMjIyBEaW1lbnNpb24gcmVkdWN0aW9uIGZvciBDb3ggbW9kZWxzIHstfQoKVGhlIGZvbGxvd2luZyBjb2RlIGRlbW9uc3RyYXRlcyB0aGUgdXNlIG9mIHRoZSBmaXJzdCB0d28gcHJpbmNpcGFsIGNvbXBvbmVudHMgb2YgUENBIGFzIGNvdmFyaWF0ZXMgZm9yIHRoZSAqKnB1cnBvc2Ugb2Ygc3Vydml2YWwgcHJlZGljdGlvbioqLgpTaW1pbGFybHksIHRoZSBmaXJzdCBjb21wb25lbnRzIGZyb20gJHQkLVNORSBvciBVTUFQIGNhbiBhbHNvIGJlIGV4dHJhY3RlZCBhcyBjb3ZhcmlhdGVzLgoKYGBge3J9CiMgcHJpbmNpcGFsIGNvbXBvbmVudCByZWdyZXNzaW9uCnhfdG1wID0gcHJjb21wKHQoVENHQV9QQU01MCkpCgojIGNob29zZSB0aGUgdG9wIHR3byBjb21wb25lbnRzIChzdWJqZWN0aXZlKSBhcyBjb3ZhcmlhdGVzClhfUEMgPSB4X3RtcCR4WywgMToyXQojIGJ1aWxkIGNsYXNzaWNhbCBzdXJ2aXZhbCBtb2RlbCAoZS5nLiBQSCBDb3ggbW9kZWwpCmRhdGFfdG1wID0gZGF0YS5mcmFtZSh0aW1lID0gY2xpbiR0aW1lLCBzdGF0dXMgPSBjbGluJHN0YXR1cywgWF9QQykKZml0ID0gY294cGgoU3Vydih0aW1lLCBzdGF0dXMpIH4gUEMxICsgUEMyLCBkYXRhID0gZGF0YV90bXApCnN1bW1hcnkoZml0KQpgYGAKYGBgCkNhbGw6CmNveHBoKGZvcm11bGEgPSBTdXJ2KHRpbWUsIHN0YXR1cykgfiBQQzEgKyBQQzIsIGRhdGEgPSBkYXRhX3RtcCkKCiAgbj0gMTA0NywgbnVtYmVyIG9mIGV2ZW50cz0gMTQ5IAoKICAgICAgICBjb2VmIGV4cChjb2VmKSBzZShjb2VmKSAgICAgeiBQcig+fHp8KSAgIApQQzEgMC4wMDQ4OTQgIDEuMDA0OTA2IDAuMDA5Njg5IDAuNTA1ICAwLjYxMzQ4ICAgClBDMiAwLjAzODI2OSAgMS4wMzkwMTAgMC4wMTMyMjQgMi44OTQgIDAuMDAzODEgKioKLS0tClNpZ25pZi4gY29kZXM6ICAwIOKAmCoqKuKAmSAwLjAwMSDigJgqKuKAmSAwLjAxIOKAmCrigJkgMC4wNSDigJgu4oCZIDAuMSDigJgg4oCZIDEKCiAgICBleHAoY29lZikgZXhwKC1jb2VmKSBsb3dlciAuOTUgdXBwZXIgLjk1ClBDMSAgICAgMS4wMDUgICAgIDAuOTk1MSAgICAgMC45ODYgICAgIDEuMDI0ClBDMiAgICAgMS4wMzkgICAgIDAuOTYyNSAgICAgMS4wMTIgICAgIDEuMDY2CgpDb25jb3JkYW5jZT0gMC41OCAgKHNlID0gMC4wMjggKQpMaWtlbGlob29kIHJhdGlvIHRlc3Q9IDguNjIgIG9uIDIgZGYsICAgcD0wLjAxCldhbGQgdGVzdCAgICAgICAgICAgID0gOC43MSAgb24gMiBkZiwgICBwPTAuMDEKU2NvcmUgKGxvZ3JhbmspIHRlc3QgPSA4LjczICBvbiAyIGRmLCAgIHA9MC4wMQpgYGAKCiMjIyBQZW5hbGl6ZWQgQ294IG1vZGVscyB7LX0KCkZvciBjb21wdXRhdGlvbmFsIGVmZmljaWVuY3ksIHdlIHdpbGwgdXNlIG9ubHkgdGhlIG1STkEtU2VxIGZlYXR1cmVzIGNvcnJlc3BvbmRpbmcgdG8gdGhlIFBBTTUwIGdlbmVzIFtAUGFya2VyMjAwOV0gaW5zdGVhZCBvZiB0aGUgdmFyaWFuY2UgZmlsdGVyZWQgZ2VuZXMgZnJvbSB0aGUgcHJldmlvdXMgc2VjdGlvbi4KV2UgcGVyZm9ybSBhbiBpbnZlc3RpZ2F0aW9uIG9mIHRoZSByZWxhdGlvbnNoaXBzIGJldHdlZW4gdGhlIG1STkEtU2VxIGZlYXR1cmVzLCB0d28gY2xpbmljYWwgdmFyaWFibGVzIChpLmUuIHRoZSBwYXRpZW50cycgYWdlIGF0IGRpYWdub3NpcyBhbmQgdGhlaXIgZXRobmljaXR5KSBhbmQgdGhlIHN1cnZpdmFsIG91dGNvbWVzLgoKVGhlIGBSYCBwYWNrYWdlIFsqKmdsbW5ldCoqXShodHRwczovL0NSQU4uUi1wcm9qZWN0Lm9yZy9wYWNrYWdlPWdsbW5ldCkgW0BGcmllZG1hbjIwMTBdIGlzIHZlcnkgY29tcHV0YXRpb25hbGx5IGVmZmljaWVudCB0byBydW4gTGFzc28gYW5kIEVsYXN0aWMgTmV0IENveCBtb2RlbHMuCkxhc3NvIGhhcyBhIHR1bmluZyBwYXJhbWV0ZXIgJFxsYW1iZGEkIHRvIGNvbnRyb2wgdGhlIHBlbmFsdHkgc3RyZW5ndGggb2YgdGhlIGNvZWZmaWNpZW50cyB3aGljaCBjYW4gYmUgb3B0aW1pemVkIGJ5IGNyb3NzLXZhbGlkYXRpb24gKENWKSB2aWEgZnVuY3Rpb24gYGN2LmdsbW5ldCgpYC4KVGhlIGBnbG1uZXQoKWAgYW5kIGBjdi5nbG1uZXQoKWAgZnVuY3Rpb25zIHByb3ZpZGUgdGhlIGFyZ3VtZW50IGBwZW5hbHR5LmZhY3RvcmAgdG8gYWxsb3cgZGlmZmVyZW50IHNocmlua2FnZXMgZm9yIGRpZmZlcmVudCBmZWF0dXJlcywgd2hpY2ggbWFrZXMgc2Vuc2UgaWYgb25lIGluY2x1ZGVzIGJvdGggY2xpbmljYWwvZGVtb2dyYXBoaWMgdmFyaWFibGVzIGFuZCBvbWljcyBmZWF0dXJlcyBhbmQgZG9lcyBub3Qgd2FudCB0byBwZXJmb3JtIGZlYXR1cmUgc2VsZWN0aW9uIGZvciB0aGUgY2xpbmljYWwvZGVtb2dyYXBoaWMgdmFyaWFibGVzLgoKYGBge3J9CiMjIExhc3NvIENveCBtb2RlbAoKIyMgZm9yIGRlbW9uc3RyYXRpb24gc2ltcGxpY2l0eSwgUEFNNTAgZ2VuZXMgYXJlIHVzZWQgaGVyZQp4ID0gY2JpbmQoYWdlID0gY2xpbiRhZ2UsIGV0aG5pY2l0eSA9IGZhY3RvcihjbGluJGV0aG5pY2l0eSksIHQoVENHQV9QQU01MCkpCnkgPSBjYmluZCh0aW1lID0gY2xpbiR0aW1lLCBzdGF0dXMgPSBjbGluJHN0YXR1cykKCiMgc2V0IHBlbmFsdHkgZmFjdG9yIHdpdGhvdXQgcGVuYWxpemluZyB0aGUgdHdvIGRlbW9ncmFwaGljYWwgdmFyaWFibGVzCnBmID0gYyhyZXAoMCwgMiksIHJlcCgxLCBuY29sKHgpIC0gMikpCgojIExhc3NvIENveCBieSB1c2luZyBjdi5nbG1uZXQgdG8gb2J0YWluIHRoZSA1LWZvbGQgQ1Ygb3B0aW1hbCBsYW1iZGEubWluIG9yIGxhbWJkYS4xc2UKc2V0LnNlZWQoMTIzKQpjdmZpdCA9IGdsbW5ldDo6Y3YuZ2xtbmV0KHgsIHksIGZhbWlseSA9ICJjb3giLCBuZm9sZHMgPSA1LCBwZW5hbHR5LmZhY3RvciA9IHBmKQptb2QgPSBjdmZpdCRnbG1uZXQuZml0CmxhbWJkYV9vcHRpbWFsID0gY3ZmaXQkbGFtYmRhLm1pbiAjIG9wdGltYWwgbGFtYmRhCgpiZXRhcyA9IGFzLnZlY3Rvcihjb2VmKG1vZCwgcyA9IGxhbWJkYV9vcHRpbWFsKSkKYmV0YS5wb3NpdGl2ZSA9IGNvbG5hbWVzKHgpW2JldGFzID4gMF0KYmV0YS5uZWdhdGl2ZSA9IGNvbG5hbWVzKHgpW2JldGFzIDwgMF0KI2dldCBvcmRlcmVkIGxpc3Qgb2YgdmFyaWFibGVzIGFzIHRoZXkgYXBwZWFyIGF0IHNtYWxsZXN0IGxhbWJkYQphbGxuYW1lcyA9IG5hbWVzKGNvZWYobW9kKVssIG5jb2woY29lZihtb2QpKV0KICAgICAgICAgICAgICAgIFtvcmRlcihjb2VmKG1vZClbLCBuY29sKGNvZWYobW9kKSldLCBkZWNyZWFzaW5nID0gVFJVRSldKQojIGFzc2lnbiBjb2xvcnMKY29scyA9IHJlcCgiZ3JheTgwIiwgbGVuZ3RoKGFsbG5hbWVzKSkKY29sc1thbGxuYW1lcyAlaW4lIGJldGEucG9zaXRpdmVdID0gInNlYWdyZWVuMyIKY29sc1thbGxuYW1lcyAlaW4lIGJldGEubmVnYXRpdmVdID0gImhvdHBpbmsiCgojIGRyd2EgY29lZmZpY2llbnQgcGF0aHMgb2YgYSBMYXNzbyBDb3ggbW9kZWwKcGxvdG1vOjpwbG90X2dsbW5ldChtb2QsIGxhYmVsID0gVFJVRSwgcyA9IGxhbWJkYV9vcHRpbWFsLCBjb2wgPSBjb2xzLAogICAgICAgICAgICB4bGFiID0gZXhwcmVzc2lvbihsb2cgfn4gbGFtYmRhKSwgeWxhYiA9IGV4cHJlc3Npb24oYmV0YSkpCnRpdGxlKCJMYXNzbyAgIFxuXG4iKQpgYGAKIVtfQ29lZmZpY2llbnQgcGF0aHMgb2YgYSBMYXNzbyBDb3ggbW9kZWwuIFRoZSB2ZXJ0aWNsZSBncmF5IGxpbmUgaW5kaWNhdGVzIHRoZSBvcHRpbWFsICRcbGFtYmRhJCBhbmQgaXRzIGNvcnJlc3BvbmRpbmdseSBzZWxlY3RlZCBmZWF0dXJlcyBhcmUgbWFya2VkIGFzIGdyZWVuIChwb3NpdGl2ZSBjb2VmZmljaWVudCkgYW5kIHJlZCAobmVnYXRpdmUgY29lZmZpY2llbnQpIGNvbG9ycy4gTm90ZSB0aGF0IHRoZSBkZW1vZ3JhcGhpYyB2YXJpYWJsZXMgYWdlIGFuZCBldGhuaWNpdHkgd2VyZSBub3QgcGVuYWxpemVkLCBzbyB0aGF0IHRoZWlyIGNvZWZmaWNpZW50IHBhdGhzIGRpZCBub3Qgc3RhcnQgZnJvbSB6ZXJvIGluIHRoZSBmaWd1cmUuX10oZmlnL1RDR0FfbGFzc28ucG5nKXt3aWR0aD02MCV9CgpFbGFzdGljIE5ldCBDb3ggbW9kZWwgaW5jbHVkZXMgdGhlICRcbGFtYmRhJCBhbmQgYW4gYWRkaXRpb25hbCBwZW5hbHR5IHBhcmFtZXRlciAkXGFscGhhIFxpbiBbMCwxXSQuClRoZSBwYXJhbWV0ZXIgJFxhbHBoYSQgY2FuIGJlIGZpeGVkIGFzICQwJCAoUmlkZ2UpLCAkMSQgKExhc3NvKSBvciBhbnkgdmFsdWUgYmV0d2VlbiAkMCQgYW5kICQxJCBmb3IgbWFraW5nIGEgY29tcHJvbWlzZSBiZXR3ZWVuIFJpZGdlIGFuZCBMYXNzbywgd2hpY2ggY2FuIGFsc28gYmUgb3B0aW1pemVkIGJ5IGNyb3NzLXZhbGlkYXRpb24gbWFudWFsbHksIHNlZSB0aGUgZXhhbXBsZSBiZWxvdy4KCmBgYHtyfQojIyBFbGFzdGljIE5ldCBDb3ggbW9kZWwKCiMgc2V0IHBlbmFsdHkgcGFyYW1ldGVyIGFscGhhIHdoaWNoIGNvbXByaXNlcyBiZXR3ZWVuIExhc3NvIGFuZCByaWRnZSByZWdyZXNzaW9ucwphbHBoYSA9IHNlcSgwLjEsIDEsIGxlbmd0aCA9IDEwKQpmaXRFTiA9IGxpc3QoKQpzZXQuc2VlZCgxMjMpCmZvcihpIGluIDE6bGVuZ3RoKGFscGhhKSkgewogIGZpdEVOW1tpXV0gPSBjdi5nbG1uZXQoeCwgeSwgZmFtaWx5ID0gImNveCIsIGFscGhhID0gYWxwaGFbaV0sIG5mb2xkcyA9IDUsIHBlbmFsdHkuZmFjdG9yID0gcGYpCn0KaWR4ID0gd2hpY2gubWluKHNhcHBseShmaXRFTiwgZnVuY3Rpb24oeHgpIHt4eCRjdm1beHgkbGFtYmRhID09IHh4JGxhbWJkYS5taW5dfSkpCmN2Zml0ID0gZml0RU5bW2lkeF1dCgojIHRoZSBmb2xsb3dpbmcgY29kZSBpcyB0aGUgc2FtZSBhcyBMYXNzbyBwcmV2aW91c2x5Cm1vZCA9IGN2Zml0JGdsbW5ldC5maXQKbGFtYmRhX29wdGltYWwgPSBjdmZpdCRsYW1iZGEubWluICMgb3B0aW1hbCBsYW1iZGEKCmJldGFzID0gYXMudmVjdG9yKGNvZWYobW9kLCBzID0gbGFtYmRhX29wdGltYWwpKQpiZXRhLnBvc2l0aXZlID0gY29sbmFtZXMoeClbYmV0YXMgPiAwXQpiZXRhLm5lZ2F0aXZlID0gY29sbmFtZXMoeClbYmV0YXMgPCAwXQphbGxuYW1lcyA9IG5hbWVzKGNvZWYobW9kKVssIG5jb2woY29lZihtb2QpKV0KICAgICAgICAgICAgICAgIFtvcmRlcihjb2VmKG1vZClbLCBuY29sKGNvZWYobW9kKSldLCBkZWNyZWFzaW5nID0gVFJVRSldKQpjb2xzID0gcmVwKCJncmF5ODAiLCBsZW5ndGgoYWxsbmFtZXMpKQpjb2xzW2FsbG5hbWVzICVpbiUgYmV0YS5wb3NpdGl2ZV0gPSAic2VhZ3JlZW4zIiAKY29sc1thbGxuYW1lcyAlaW4lIGJldGEubmVnYXRpdmVdID0gImhvdHBpbmsiICAgCgpwbG90bW86OnBsb3RfZ2xtbmV0KG1vZCwgbGFiZWwgPSBUUlVFLCBzID0gbGFtYmRhX29wdGltYWwsIGNvbCA9IGNvbHMsCiAgICAgICAgICAgIHhsYWIgPSBleHByZXNzaW9uKGxvZyB+fiBsYW1iZGEpLCB5bGFiID0gZXhwcmVzc2lvbihiZXRhKSkKdGl0bGUoIkVsYXN0aWMgTmV0ICAgICBcblxuIikKYGBgCiFbX0NvZWZmaWNpZW50IHBhdGhzIG9mIGFuIEVsYXN0aWMgTmV0IENveCBtb2RlbC4gVGhlIHZlcnRpY2xlIGdyYXkgbGluZSBpbmRpY2F0ZXMgdGhlIG9wdGltYWwgJFxsYW1iZGEkIGFuZCBpdHMgY29ycmVzcG9uZGluZ2x5IHNlbGVjdGVkIGZlYXR1cmVzIGFyZSBtYXJrZWQgYXMgZ3JlZW4gKHBvc2l0aXZlIGNvZWZmaWNpZW50KSBhbmQgcmVkIChuZWdhdGl2ZSBjb2VmZmljaWVudCkgY29sb3JzLiBOb3RlIHRoYXQgdGhlIGRlbW9ncmFwaGljIHZhcmlhYmxlcyBhZ2UgYW5kIGV0aG5pY2l0eSB3ZXJlIG5vdCBwZW5hbGl6ZWQsIHNvIHRoYXQgdGhlaXIgY29lZmZpY2llbnQgcGF0aHMgZGlkIG5vdCBzdGFydCBmcm9tIHplcm8gaW4gdGhlIGZpZ3VyZS5fXShmaWcvVENHQV9lbGFzdGljLnBuZyl7d2lkdGg9NjAlfQoKQWRhcHRpdmUgTGFzc28gQ294IG1vZGVsIG5lZWRzIHRvIHByZS1lc3RpbWF0ZSBhbGwgY29lZmZpY2llbnRzIHdoaWNoIHdpbGwgYmUgdXNlZCBhcyB3ZWlnaHRzIHZpYSB0aGUgYXJndW1lbnQgYHBlbmFsdHkuZmFjdG9yYCBpbiB0aGUgYGdsbW5ldCgpYCBhbmQgYGN2LmdsbW5ldCgpYCBmdW5jdGlvbnMgdG8gZml0IGEgTGFzc28gQ294IG1vZGVsLgpUaGUgcHJlLWVzdGltYXRpb24gY2FuIGJlIGRvbmUgYnkgYSBSaWRnZSBDb3ggbW9kZWwsIHNlZSBhbiBleGFtcGxlIGJlbG93LgoKYGBge3J9CiMjIEFkYXB0aXZlIExhc3NvIENveCBtb2RlbAoKc2V0LnNlZWQoMTIzKQpmaXQgPSBjdi5nbG1uZXQoeCwgeSwgZmFtaWx5ID0gImNveCIsIGFscGhhID0gMCwgbmZvbGRzID0gNSkKd2VpZ2h0cyA9IGFicygxIC8gYXMudmVjdG9yKGNvZWYoZml0LCBzID0gImxhbWJkYS5taW4iKSkpCgojIGFkYXB0aXZlIExhc3NvIENveCBieSB1c2luZyBjdi5nbG1uZXQgdG8gb2J0YWluIHRoZSA1LWZvbGQgQ1Ygb3B0aW1hbCBsYW1iZGEubWluIG9yIGxhbWJkYS4xc2UKY3ZmaXQgPSBjdi5nbG1uZXQoeCwgeSwgZmFtaWx5ID0gImNveCIsIG5mb2xkcyA9IDUsIHBlbmFsdHkuZmFjdG9yID0gcGYpCm1vZCA9IGN2Zml0JGdsbW5ldC5maXQKbGFtYmRhX29wdGltYWwgPSBjdmZpdCRsYW1iZGEubWluICMgb3B0aW1hbCBsYW1iZGEKCmJldGFzID0gYXMudmVjdG9yKGNvZWYobW9kLCBzID0gbGFtYmRhX29wdGltYWwpKQpiZXRhLnBvc2l0aXZlID0gY29sbmFtZXMoeClbYmV0YXMgPiAwXQpiZXRhLm5lZ2F0aXZlID0gY29sbmFtZXMoeClbYmV0YXMgPCAwXQojZ2V0IG9yZGVyZWQgbGlzdCBvZiB2YXJpYWJsZXMgYXMgdGhleSBhcHBlYXIgYXQgc21hbGxlc3QgbGFtYmRhCmFsbG5hbWVzID0gbmFtZXMoY29lZihtb2QpWywgbmNvbChjb2VmKG1vZCkpXQogICAgICAgICAgICAgICAgW29yZGVyKGNvZWYobW9kKVssIG5jb2woY29lZihtb2QpKV0sIGRlY3JlYXNpbmcgPSBUUlVFKV0pCiNhc3NpZ24gY29sb3JzCmNvbHMgPSByZXAoImdyYXk4MCIsIGxlbmd0aChhbGxuYW1lcykpCmNvbHNbYWxsbmFtZXMgJWluJSBiZXRhLnBvc2l0aXZlXSA9ICJzZWFncmVlbjMiCmNvbHNbYWxsbmFtZXMgJWluJSBiZXRhLm5lZ2F0aXZlXSA9ICJob3RwaW5rIgoKcGxvdF9nbG1uZXQobW9kLCBsYWJlbCA9IFRSVUUsIHMgPSBsYW1iZGFfb3B0aW1hbCwgY29sID0gY29scywKICAgICAgICAgICAgeGxhYiA9IGV4cHJlc3Npb24obG9nIH4gbGFtYmRhKSwgeWxhYiA9IGV4cHJlc3Npb24oYmV0YSkpCnRpdGxlKCJBZGF0aXZlIExhc3NvICAgIFxuXG4iKQpgYGAKIVtfQ29lZmZpY2llbnQgcGF0aHMgb2YgYW4gYWRhcHRpdmUgTGFzc28gQ294IG1vZGVsLiBUaGUgdmVydGljbGUgZ3JheSBsaW5lIGluZGljYXRlcyB0aGUgb3B0aW1hbCAkXGxhbWJkYSQgYW5kIGl0cyBjb3JyZXNwb25kaW5nbHkgc2VsZWN0ZWQgZmVhdHVyZXMgYXJlIG1hcmtlZCBhcyBncmVlbiAocG9zaXRpdmUgY29lZmZpY2llbnQpIGFuZCByZWQgKG5lZ2F0aXZlIGNvZWZmaWNpZW50KSBjb2xvcnMuIE5vdGUgdGhhdCB0aGUgZGVtb2dyYXBoaWMgdmFyaWFibGVzIGFnZSBhbmQgZXRobmljaXR5IHdlcmUgbm90IHBlbmFsaXplZCwgc28gdGhhdCB0aGVpciBjb2VmZmljaWVudCBwYXRocyBkaWQgbm90IHN0YXJ0IGZyb20gemVybyBpbiB0aGUgZmlndXJlLl9dKGZpZy9UQ0dBX2FkYXB0aXZlbGFzc28ucG5nKXt3aWR0aD02MCV9CgpHcm91cCBMYXNzbyBDb3ggbW9kZWwgY2FuIGJlIGltcGxlbWVudGVkIHRocm91Z2ggdGhlIGBSYCBwYWNrYWdlIFsqKmdycHJlZyoqXShodHRwczovL0NSQU4uUi1wcm9qZWN0Lm9yZy9wYWNrYWdlPWdycHJlZykgW0BCcmVoZW55MjAxNV0uCkZvciBhbiBpbGx1c3RyYXRpb24sIHdlIHNwZWNpZnkgdGhlIHR3byBkZW1vZ3JhcGhpYyB2YXJpYWJsZXMgYXMgdGhlIGZpcnN0IGdyb3VwLCB0aGUgZmlyc3QgJDEwJCBQQU01MCBnZW5lcyBhcyB0aGUgc2Vjb25kIGdyb3VwLCB0aGUgbGFzdCAkNDAkIFBBTTUwIGdlbmVzIGFzIHRoZSB0aGlyZCBncm91cC4KQSAkayQtZm9sZCBjcm9zcy12YWxpZGF0aW9uIChDVikgZm9yIHRoZSBncm91cCBMYXNzbyBDb3ggbW9kZWwgaXMgcGVyZm9ybWVkIHRocm91Z2ggZnVuY3Rpb24gYGN2LmdycHN1cnYoKWAuClRoZSByZXR1cm5lZCBvYmplY3QgYGN2Zml0JGxhbWJkYS5taW5gIGlzIHRoZSB2YWx1ZSBvZiBDVi1vcHRpbWl6ZWQgJFxsYW1iZGEkLgpUaGUgZm9sbG93aW5nIHJlc3VsdHMgc2hvdyB0aGF0IAoKLSB3aGVuIGNob29zaW5nIHRoZSBDVi1vcHRpbWl6ZWQgJFxsYW1iZGEgPSAwLjAxNDMkIChvdXRwdXQgbWF0cml4IGhhcyBsYW1iZGEgdmFsdWVzIGFzIGNvbHVtbiBuYW1lcyksIHRoZSBlc3RpbWF0ZWQgY29lZmZpY2llbnRzIG9mIHRoZSBmaXJzdCB0d28gZ3JvdXBzIGFyZSBub256ZXJvIChpLmUuIHNlbGVjdGluZyBmaXJzdCBhbmQgc2Vjb25kIGdyb3Vwcyk7Ci0gd2hlbiBjaG9vc2luZyB0aGUgJDEwJC10aCBsYW1iZGEgJFxsYW1iZGEgPSAwLjAyMTckLCBvbmx5IHRoZSBmaXJzdCBncm91cCBvZiBjb3ZhcmlhdGVzIGhhcyBub256ZXJvIGNvZWZmaWNpZW50cyAoaS5lLiBzZWxlY3RpbmcgZmlyc3QgZ3JvdXApOwotIHdoZW4gY2hvb3NpbmcgdGhlICQxNSQtdGggbGFtYmRhICRcbGFtYmRhID0gMC4wMTA4JCwgdGhlIGVzdGltYXRlZCBjb2VmZmljaWVudHMgb2YgYWxsIHRoZSB0aHJlZSBncm91cHMgYXJlIG5vbnplcm8gKGkuZS4gc2VsZWN0aW5nIGFsbCBncm91cHMpLiAKCk5vdGUgdGhhdCB0aGUgYFJgIHBhY2thZ2UgWyoqZ3JwcmVnKipdKGh0dHBzOi8vQ1JBTi5SLXByb2plY3Qub3JnL3BhY2thZ2U9Z3JwcmVnKSBbQEJyZWhlbnkyMDE1XSBhbHNvIGltcGxlbWVudHMgZ3JvdXAgc21vb3RobHkgY2xpcHBlZCBhYnNvbHV0ZSBkZXZpYXRpb24gKFNDQUQpIG1vZGVsIGFuZCBzb21lIG90aGVycywgc2VlIEBCcmVoZW55MjAyMSBmb3IgZGV0YWlscy4KCmBgYHtyfQojIGdyb3VwIExhc3NvIENveCBtb2RlbApncm91cCA9IGMocmVwKCJkZW1vZ3JhcGhpYyIsIDIpLCByZXAoIlBBTTUwXzEiLCAxMCksIHJlcCgiUEFNNTBfMiIsIDQwKSkKZ3JvdXAgPSBmYWN0b3IoZ3JvdXApCnNldC5zZWVkKDEyMykKY3ZmaXQgPSBncnByZWc6OmN2LmdycHN1cnYoWCA9IHgsIHkgPSB5LCBncm91cCA9IGdyb3VwLCBwZW5hbHR5ID0gImdyTGFzc28iLCByZXR1cm5ZID0gVFJVRSkKcm91bmQoY3ZmaXQkZml0JGJldGFbLCBjKHdoaWNoLm1pbihjdmZpdCRjdmUpLCAxMCwgMjApXSwgZGlnaXRzID0gNCkKYGBgCmBgYAogICAgICAgICAgIDAuMDE0MyAgMC4wMjE3ICAwLjAxMDgKYWdlICAgICAgICAwLjAyMTkgIDAuMDE1NCAgMC4wMjQ3CmV0aG5pY2l0eSAtMC4wNTQyIC0wLjA0MjUgLTAuMDU2OQpVQkUyVCAgICAgIDAuMDIwOSAgMC4wMDAwICAwLjA3MzIKQklSQzUgICAgIC0wLjAwMzUgIDAuMDAwMCAtMC4wMTA5Ck5VRjIgICAgICAtMC4wMDMxICAwLjAwMDAgLTAuMDA5MwpDREM2ICAgICAgIDAuMDE1NSAgMC4wMDAwICAwLjA1NDYKQ0NOQjEgICAgIC0wLjAyNDcgIDAuMDAwMCAtMC4wODQ2ClRZTVMgICAgICAtMC4wMDI4ICAwLjAwMDAgLTAuMDA4NgpNWUJMMiAgICAgLTAuMDE0NyAgMC4wMDAwIC0wLjA1MjIKQ0VQNTUgICAgICAwLjAxNTIgIDAuMDAwMCAgMC4wNTA3Ck1FTEsgICAgICAtMC4wMDAxICAwLjAwMDAgLTAuMDAwNgpOREM4MCAgICAgIDAuMDAwNyAgMC4wMDAwICAwLjAwMjIKUlJNMiAgICAgICAwLjAwMDAgIDAuMDAwMCAtMC4wMTAwClVCRTJDICAgICAgMC4wMDAwICAwLjAwMDAgIDAuMDA3NgpDRU5QRiAgICAgIDAuMDAwMCAgMC4wMDAwIC0wLjAwMDIKUFRURzEgICAgICAwLjAwMDAgIDAuMDAwMCAgMC4wMDUyCkVYTzEgICAgICAgMC4wMDAwICAwLjAwMDAgLTAuMDAwMgpPUkM2TCAgICAgIDAuMDAwMCAgMC4wMDAwIC0wLjA0NjQKQU5MTiAgICAgICAwLjAwMDAgIDAuMDAwMCAtMC4wMTc1CkNDTkUxICAgICAgMC4wMDAwICAwLjAwMDAgLTAuMDE1NQpDREMyMCAgICAgIDAuMDAwMCAgMC4wMDAwIC0wLjAxNDIKTUtJNjcgICAgICAwLjAwMDAgIDAuMDAwMCAtMC4wMjQ1CktJRjJDICAgICAgMC4wMDAwICAwLjAwMDAgLTAuMDEyMwpBQ1RSM0IgICAgIDAuMDAwMCAgMC4wMDAwICAwLjAwNDMKTVlDICAgICAgICAwLjAwMDAgIDAuMDAwMCAtMC4wMTM3CkVHRlIgICAgICAgMC4wMDAwICAwLjAwMDAgIDAuMDMxOQpLUlQ1ICAgICAgIDAuMDAwMCAgMC4wMDAwIC0wLjAwNTkKUEhHREggICAgICAwLjAwMDAgIDAuMDAwMCAgMC4wMDA0CkNESDMgICAgICAgMC4wMDAwICAwLjAwMDAgLTAuMDI2NQpNSUEgICAgICAgIDAuMDAwMCAgMC4wMDAwICAwLjAwNDkKS1JUMTcgICAgICAwLjAwMDAgIDAuMDAwMCAtMC4wMDg4CkZPWEMxICAgICAgMC4wMDAwICAwLjAwMDAgIDAuMDA5NgpTRlJQMSAgICAgIDAuMDAwMCAgMC4wMDAwICAwLjAyMzUKS1JUMTQgICAgICAwLjAwMDAgIDAuMDAwMCAgMC4wMjE4CkVTUjEgICAgICAgMC4wMDAwICAwLjAwMDAgLTAuMDE1OApTTEMzOUE2ICAgIDAuMDAwMCAgMC4wMDAwICAwLjAyODQKQkFHMSAgICAgICAwLjAwMDAgIDAuMDAwMCAgMC4wMTA0Ck1BUFQgICAgICAgMC4wMDAwICAwLjAwMDAgIDAuMDAyMwpQR1IgICAgICAgIDAuMDAwMCAgMC4wMDAwICAwLjAwOTUKQ1hYQzUgICAgICAwLjAwMDAgIDAuMDAwMCAtMC4wMTgyCk1MUEggICAgICAgMC4wMDAwICAwLjAwMDAgLTAuMDA1OQpCQ0wyICAgICAgIDAuMDAwMCAgMC4wMDAwICAwLjAxMzMKTURNMiAgICAgICAwLjAwMDAgIDAuMDAwMCAtMC4wMDg0Ck5BVDEgICAgICAgMC4wMDAwICAwLjAwMDAgLTAuMDAwOApGT1hBMSAgICAgIDAuMDAwMCAgMC4wMDAwIC0wLjAwNTUKQkxWUkEgICAgICAwLjAwMDAgIDAuMDAwMCAgMC4wMDUzCk1NUDExICAgICAgMC4wMDAwICAwLjAwMDAgLTAuMDAzNwpHUFIxNjAgICAgIDAuMDAwMCAgMC4wMDAwIC0wLjAzMjgKRkdGUjQgICAgICAwLjAwMDAgIDAuMDAwMCAtMC4wMDI5CkdSQjcgICAgICAgMC4wMDAwICAwLjAwMDAgIDAuMDA4NgpUTUVNNDVCICAgIDAuMDAwMCAgMC4wMDAwIC0wLjAwNzgKRVJCQjIgICAgICAwLjAwMDAgIDAuMDAwMCAtMC4wMTk0CmBgYAoKU3BhcnNlIGdyb3VwIExhc3NvIENveCBtb2RlbCBpcyBpbXBsZW1lbnRlZCBpbiB0aGUgYFJgIHBhY2thZ2UgWyoqU0dMKipdKGh0dHBzOi8vQ1JBTi5SLXByb2plY3Qub3JnL3BhY2thZ2U9U0dMKSBbQFNpbW9uMjAxOV0uIApUaGUgZnVuY3Rpb24gYGN2U0dMKClgIHVzZXMgY3Jvc3MgdmFsaWRhdGlvbiB0byBvcHRpbWl6ZSB0aGUgcGVuYWx0eSBwYXJhbWV0ZXIgJFxsYW1iZGEkLgpUaGUgZm9sbG93aW5nIGV4YW1wbGUgc2hvd3MgdGhhdCBpdCBpbmR1Y2VzIHNwYXJzaXR5IGluIGVhY2ggZ3JvdXAgb2YgY292YXJpYXRlcy4gCgpgYGB7cn0KIyBzcGFyc2UgZ3JvdXAgTGFzc28gQ294IG1vZGVsCmdyb3VwID0gYyhyZXAoImRlbW9ncmFwaGljIiwgMiksIHJlcCgiUEFNNTBfMSIsIDEwKSwgcmVwKCJQQU01MF8yIiwgNDApKQpncm91cCA9IGZhY3Rvcihncm91cCkKZGF0X3RtcCA9IGxpc3QoeCA9IHgsIHRpbWUgPSBjbGluJHRpbWUsIHN0YXR1cyA9IGNsaW4kc3RhdHVzKQpzZXQuc2VlZCgxMjMpCmN2Zml0ID0gU0dMOjpjdlNHTChkYXRfdG1wLCBpbmRleCA9IGdyb3VwLCB0eXBlID0gImNveCIsIG5mb2xkID0gNSkKYmV0YS5oYXQgPSBjdmZpdCRmaXQkYmV0YVssIHdoaWNoLm1pbihjdmZpdCRsbGRpZmYpXQpuYW1lcyhiZXRhLmhhdCkgPSBwYXN0ZTAoImdyb3VwIiwgYXMubnVtZXJpYyhncm91cCksICIuIiwgYygxOjIsIDE6MTAsIDE6NDApKQpiZXRhLmhhdApgYGAKYGBgCiAgIGdyb3VwMS4xICAgIGdyb3VwMS4yICAgIGdyb3VwMi4xICAgIGdyb3VwMi4yICAgIGdyb3VwMi4zICAgIGdyb3VwMi40IAogNS42ODM4NzU3MCAgMC4wMDAwMDAwMCAgMC41MDcxMTc0MCAgMC4wMDAwMDAwMCAgMC4wMDAwMDAwMCAgMC4yMTUyMjQ5MCAKICAgZ3JvdXAyLjUgICAgZ3JvdXAyLjYgICAgZ3JvdXAyLjcgICAgZ3JvdXAyLjggICAgZ3JvdXAyLjkgICBncm91cDIuMTAgCiAwLjAwMDAwMDAwICAwLjAwMDAwMDAwICAwLjAwMDAwMDAwICAwLjM0MTY4NjY5ICAwLjAwMDAwMDAwICAwLjAwMDAwMDAwIAogICBncm91cDMuMSAgICBncm91cDMuMiAgICBncm91cDMuMyAgICBncm91cDMuNCAgICBncm91cDMuNSAgICBncm91cDMuNiAKIDAuMDAwMDAwMDAgIDAuMjU2OTE0NzggIDAuMDAwMDAwMDAgLTAuMzc0OTQ3MjYgIDAuMDAwMDAwMDAgLTIuODUxMTAxNDYgCiAgIGdyb3VwMy43ICAgIGdyb3VwMy44ICAgIGdyb3VwMy45ICAgZ3JvdXAzLjEwICAgZ3JvdXAzLjExICAgZ3JvdXAzLjEyIAotMS45MzU1Njk5NCAgMC4wMDAwMDAwMCAgMC4wMDAwMDAwMCAgMC4wMDAwMDAwMCAtMS43NzgwNTU0MiAgMC4wMDAwMDAwMCAKICBncm91cDMuMTMgICBncm91cDMuMTQgICBncm91cDMuMTUgICBncm91cDMuMTYgICBncm91cDMuMTcgICBncm91cDMuMTggCiAwLjAwMDAwMDAwICAxLjAzODE5Nzc4ICAwLjAwMDAwMDAwICAwLjAwMDAwMDAwICAwLjAwMDAwMDAwICAwLjAwMDAwMDAwIAogIGdyb3VwMy4xOSAgIGdyb3VwMy4yMCAgIGdyb3VwMy4yMSAgIGdyb3VwMy4yMiAgIGdyb3VwMy4yMyAgIGdyb3VwMy4yNCAKIDAuMDAwMDAwMDAgIDAuMDAwMDAwMDAgIDAuMDAwMDAwMDAgIDAuMDAwMDAwMDAgLTAuMzQ0OTY3MTcgIDAuMDAwMDAwMDAgCiAgZ3JvdXAzLjI1ICAgZ3JvdXAzLjI2ICAgZ3JvdXAzLjI3ICAgZ3JvdXAzLjI4ICAgZ3JvdXAzLjI5ICAgZ3JvdXAzLjMwIAogMS4wMTU1MjA5NSAgMC4wMDAwMDAwMCAgMC4wMDAwMDAwMCAgMC4wMDAwMDAwMCAgMC4wMDAwMDAwMCAgMC4wMDAwMDAwMCAKICBncm91cDMuMzEgICBncm91cDMuMzIgICBncm91cDMuMzMgICBncm91cDMuMzQgICBncm91cDMuMzUgICBncm91cDMuMzYgCi0yLjEzMjA1NTg3ICAwLjAwMDAwMDAwICAwLjAwMDAwMDAwICAwLjAwMDAwMDAwICAwLjAwMDAwMDAwIC0wLjk1MDQ4MTIxIAogIGdyb3VwMy4zNyAgIGdyb3VwMy4zOCAgIGdyb3VwMy4zOSAgIGdyb3VwMy40MCAKLTEuODYyMjIxMDUgLTAuMDExMjA1NzMgLTAuODExNTc2NDYgLTIuMTQxNDg5MDAgCmBgYAoKIyMjIFNwYXJzZSBCYXllc2lhbiBDb3ggbW9kZWxzCgpUaGUgYFJgIHBhY2thZ2UgWyoqcHNiY0dyb3VwKipdKGh0dHBzOi8vQ1JBTi5SLXByb2plY3Qub3JnL3BhY2thZ2U9cHNiY0dyb3VwKSBbQExlZTIwMjFdIGludGVncmF0ZXMgYSBsYXJnZSBzZXQgb2Ygc3BhcnNlIEJheWVzaWFuIENveCBtb2RlbHMuClRoZSBmdW5jdGlvbiBgcHNiY0dMKClgIGltcGxlbWVudHMgQmF5ZXNpYW4gQ294IG1vZGVscyB3aXRoIExhc3NvIGFuZCBncm91cCBMYXNzbyBwcmlvcnMgZm9yIGZlYXR1cmUgc2VsZWN0aW9uIGFuZCBncm91cCBzZWxlY3Rpb24gcmVzcGVjdGl2ZWx5LgpGb3IgdGhlIExhc3NvIHByaW9yLCBzZXQgdGhlIGh5cGVycGFyYW1ldGVyIGBwcmlvclBhcmEkZ3JvdXBJbmQgPSAxOnBgIHdoZXJlICRwJCBpcyB0aGUgdG90YWwgbnVtYmVyIG9mIGNvdmFyaWF0ZXMuCkZvciB0aGUgZ3JvdXAgTGFzc28gcHJpb3IsIHNldCB0aGUgaHlwZXJwYXJhbWV0ZXIgYHByaW9yUGFyYSRncm91cEluZGAgYXMgYSB2ZWN0b3Igb2Ygc2l6ZSAkcCQsIHdoZXJlIGVhY2ggZWxlbWVudCBkZW5vdGVzIHdoaWNoIGdyb3VwIGVhY2ggY292YXJpYXRlIGNvcnJlc3BvbmRzIHRvLgpOb3RlIHRoYXQgKipwc2JjR3JvdXAqKiBjYW5ub3QgZGlzdGluZ3Vpc2ggbWFuZGF0b3J5ICh1bnBlbmFsaXplZCkgY292YXJpYXRlcyB3aXRoIG9taWNzIGZlYXR1cmVzLCBzZWUgQFp1Y2tuaWNrMjAxNSBmb3IgYW4gZXh0ZW5kZWQgQmF5ZXNpYW4gTGFzc28gQ294IG1vZGVsLgoKYGBge3J9CiMgQmF5ZXNpYW4gQ294IG1vZGVsIHdpdGggTGFzc28gcHJpb3IKc2V0LnNlZWQoMTIzKQpzdXJ2T2JqID0gbGlzdCh0ID0gY2xpbiR0aW1lLCBkaSA9IGNsaW4kc3RhdHVzLCB4ID0geCkKcCA9IG5jb2woeCkKIyBzZXQgaHlwZXJwYXJhbWV0ZXJzLiAKIyBGb3IgTGFzc28gcHJpb3IgKGkuZS4gJ2dyb3VwSW5kJz0gMTpwKSwgbGFyZ2VyIHJhdGlvIHIvZGVsdGEgdGVuZHMgdG8gZm9yY2UgdGhlIHBvc3RlcmlvciBiZXRhcyB0byBiZSBtb3JlIGNvbmNlbnRyYXRlZCBhdCAwCiMgRm9yIGdyb3VwIExhc3NvIHByaW9yIChpLmUuICdncm91cEluZCcgYXMgZ3JvdXAgaW5kaWNhdG9yIGZvciBjb3ZhcmlhdGVzKSwgbGFyZ2VyIHJhdGlvIHIvZGVsdGEgdGVuZHMgdG8gZm9yY2Ugc3Ryb25nZXIgZ3JvdXBpbmcgZWZmZWN0IG9mIGNvdmFyaWF0ZXMKcyA9IGMoc29ydChzdXJ2T2JqJHRbc3Vydk9iaiRkaSA9PSAxXSksIDIgKiBtYXgoc3Vydk9iaiR0KSAtIG1heChzdXJ2T2JqJHRbLXdoaWNoKHN1cnZPYmokdD09bWF4KHN1cnZPYmokdCkpXSkpCnByaW9yUGFyYSA9IGxpc3QoJ2V0YTAnID0gMSwgJ2thcHBhMCcgPSAxLCAnYzAnPSAyLCAncicgPSAwLjUsIAogICAgICAgICAgICAgICAgICAnZGVsdGEnID0gMC4wMDAxLCAncyc9IHMsICdKJz1sZW5ndGgocyksICdncm91cEluZCc9IDE6cCkKIyBzZXQgTUNNQyBwYXJhbWV0ZXJzCm1jbWNQYXJhID0gbGlzdCgnbnVtQmV0YSc9IHAsICdiZXRhLnByb3AudmFyJz0gMSkKIyBzZXQgaW5pdGlhbCB2YWx1ZXMgb2YgaHlwZXJwYXJhbWV0ZXJzCmxhbWJkYVNxID0gMQppbml0aWFsID0gbGlzdCgnYmV0YS5pbmknPSByZXAoMCwgcCksICdsYW1iZGFTcScgPSAxLCAnc2lnbWFTcScgPSBydW5pZigxLCAwLjEsIDEwKSwKICAgICAgICAgICAgICAgICd0YXVTcScgPSByZXhwKGxlbmd0aCh1bmlxdWUocHJpb3JQYXJhJGdyb3VwSW5kKSksICdyYXRlJyA9IGxhbWJkYVNxIC8gMiksCiAgICAgICAgICAgICAgICAnaCcgPSByZ2FtbWEocHJpb3JQYXJhJEosIDEsIDEpKQojIGluIHJlYWwgYXBwbGljYXRpb25zLCAnbnVtLnJlcHMnIHNob3VsZCBiZSBsYXJnZSBlbm91Z2ggKGUuZy4gMjAwMDAsIDQwMDAwKSBhbmQgJ2NoYWluJyB0byBiZSA+IDEKQmF5ZXNMYXNzb2ZpdCA9IHBzYmNHcm91cDo6cHNiY0dMKHN1cnZPYmosIHByaW9yUGFyYSwgaW5pdGlhbCwgcncgPSBUUlVFLCBtY21jUGFyYSwgbnVtLnJlcHMgPSAxMDAsIHRoaW4gPSAxLCBjaGFpbiA9IDEpCiMgYnVybi1pbiB0aGUgZmlyc3QgaGFsZiBNQ01DIGl0ZXJhdGlvbnMKYmV0YV9wID0gQmF5ZXNMYXNzb2ZpdCRiZXRhLnBbLSgxOjUxKSwgXQpiZXRhX21lYW4gPSBjb2xNZWFucyhiZXRhX3ApCmJldGFfTCA9IGFwcGx5KGJldGFfcCwgMiwgcXVhbnRpbGUsIDAuMDI1KQpiZXRhX1UgPSBhcHBseShiZXRhX3AsIDIsIHF1YW50aWxlLCAwLjk3NSkKdGJsID0gZGF0YS5mcmFtZSh0ZXJtID0gY29sbmFtZXMoeCksIGVzdGltYXRlID0gYmV0YV9tZWFuLCAgY29uZi5sb3cgPSBiZXRhX0wsICBjb25mLmhpZ2ggPSBiZXRhX1UpCnRibCR0ZXJtID0gZmFjdG9yKHRibCR0ZXJtLCBsZXZlbHMgPSB0YmwkdGVybSkKCkdHYWxseTo6Z2djb2VmKHRibCkgKyBjb29yZF9mbGlwKCkgKyB4bGFiKGV4cHJlc3Npb24oUG9zdGVyaW9yfn5iZXRhKSkgKyAKICB5bGFiKCIiKSArIHRoZW1lKGF4aXMudGV4dC54ID0gZWxlbWVudF90ZXh0KGFuZ2xlID0gOTAsIHNpemUgPSA3KSkKYGBgCiFbX0VzdGltYXRlcyBvZiByZWdyZXNzaW9uIGNvZWZmaWNpZW50cyBieSBhIHBlbmFsaXplZCBzZW1pcGFyYW1ldHJpYyBCYXllc2lhbiBDb3ggbW9kZWwgd2l0aCBMYXNzbyBwcmlvci4gU29saWQgZG90cyBpbmRpY2F0ZSB0aGUgcG9zdGVyaW9yIG1lYW4gb3ZlciBNQ01DIGl0ZXJhdGlvbnMgKGV4Y2x1ZGluZyBidXJuLWluIHBlcmlvZCksIGFuZCB2ZXJ0aWNsZSBsaW5lcyBzaG93IHRoZSBjb3JyZXNwb25kaW5nIDk1JSBjcmVkaWJpbGl0eSBpbnRlcnZhbHMuX10oZmlnL1RDR0FfYmF5ZXNsYXNzby5wbmcpe3dpZHRoPTYwJX0KCkluIHRoZSBgUmAgcGFja2FnZSBbKipwc2JjR3JvdXAqKl0oaHR0cHM6Ly9DUkFOLlItcHJvamVjdC5vcmcvcGFja2FnZT1wc2JjR3JvdXApIFtATGVlMjAyMV0sIGZ1bmN0aW9uIGBwc2JjRU4oKWAgaW1wbGVtZW50cyBCYXllc2lhbiBDb3ggbW9kZWxzIHdpdGggRWxhc3RpYyBOZXQgcHJpb3IgZm9yIGZlYXR1cmUgc2VsZWN0aW9uIHdpdGggZ3JvdXBpbmcgZWZmZWN0IG9mIGNvcnJlbGF0ZWQgZmVhdHVyZXMuCkZ1bmN0aW9uIGBwc2JjRkwoKWAgaW1wbGVtZW50cyBCYXllc2lhbiBDb3ggbW9kZWxzIHdpdGggZnVzZWQgTGFzc28gcHJpb3IuCgpgYGB7cn0KIyBCYXllc2lhbiBDb3ggbW9kZWwgd2l0aCBFbGFzdGljIE5ldCBwcmlvcgpzZXQuc2VlZCgxMjMpCiMgc2V0IGh5cGVycGFyYW1ldGVycwojIExhcmdlciByYXRpbyByMS9kZWx0YTEgZm9yY2VzIHRoZSBwb3N0ZXJpb3IgYmV0YXMgdG8gYmUgbW9yZSBjb25jZW50cmF0ZWQgYXQgMAojIExhcmdlciByYXRpbyByMi9kZWx0YTIgZm9yY2VzIHN0cm9uZ2VyIGdyb3VwaW5nIGVmZmVjdCBvZiBjb3ZhcmlhdGVzCnByaW9yUGFyYSA9IGxpc3QoJ2V0YTAnID0gMSwgJ2thcHBhMCcgPSAxLCAnYzAnPSAyLCAncjEnID0gMC4xLCAncjInID0gMSwgCiAgICAgICAgICAgICAgICAgICdkZWx0YTEnID0gMC4xLCAnZGVsdGEyJyA9IDEsICdzJz0gcywgJ0onID0gbGVuZ3RoKHMpKQojIHNldCBNQ01DIHBhcmFtZXRlcnMKbWNtY1BhcmEgPSBsaXN0KCdudW1CZXRhJz0gcCwgJ2JldGEucHJvcC52YXInPSAxKQojIHNldCBpbml0aWFsIHZhbHVlcyBvZiBoeXBlcnBhcmFtZXRlcnMKaW5pdGlhbCA9IGxpc3QoJ2JldGEuaW5pJz0gcmVwKDAsIHApLCAnbGFtYmRhMVNxJyA9IDEsICdsYW1iZGEyJyA9IDEsICdzaWdtYVNxJyA9IHJ1bmlmKDEsIDAuMSwgMTApLAogICAgICAgICAgICAgICAgJ3RhdVNxJyA9IHJleHAocCwgcmF0ZSA9IDEgLyAyKSwgJ2gnID0gcmdhbW1hKHByaW9yUGFyYSRKLCAxLCAxKSkKIyBpbiByZWFsIGFwcGxpY2F0aW9uLCAnbnVtLnJlcHMnIHNob3VsZCBiZSBsYXJnZSBlbm91Z2ggKGUuZy4gMjAwMDAsIDQwMDAwKSBhbmQgJ2NoYWluJyB0byBiZSA+IDEKQmF5ZXNFTmZpdCA9IHBzYmNFTihzdXJ2T2JqLCBwcmlvclBhcmEsIGluaXRpYWwsIHJ3ID0gVFJVRSwgbWNtY1BhcmEsIG51bS5yZXBzID0gMTAwLCB0aGluID0gMSwgY2hhaW4gPSAxKQojIGJ1cm4taW4gdGhlIGZpcnN0IGhhbGYgTUNNQyBpdGVyYXRpb25zCkVOX2JldGFfcCA9IEJheWVzRU5maXQkYmV0YS5wWzUyOjEwMSwgXQpFTl9iZXRhX21lYW4gPSBjb2xNZWFucyhFTl9iZXRhX3ApCkVOX2JldGFfTCA9IGFwcGx5KEVOX2JldGFfcCwgMiwgcXVhbnRpbGUsIDAuMDI1KQpFTl9iZXRhX1UgPSBhcHBseShFTl9iZXRhX3AsIDIsIHF1YW50aWxlLCAwLjk3NSkKRU5fdGJsID0gZGF0YS5mcmFtZSh0ZXJtID0gY29sbmFtZXMoeCksIGVzdGltYXRlID0gRU5fYmV0YV9tZWFuLCBjb25mLmxvdyA9IEVOX2JldGFfTCwgY29uZi5oaWdoID0gRU5fYmV0YV9VKQpFTl90YmwkdGVybSA9IGZhY3RvcihFTl90YmwkdGVybSwgbGV2ZWxzID0gRU5fdGJsJHRlcm0pCgpnZ2NvZWYoRU5fdGJsKSArIGNvb3JkX2ZsaXAoKSArIHhsYWIoZXhwcmVzc2lvbihQb3N0ZXJpb3J+fmJldGEpKSArIAogIHlsYWIoIiIpICsgdGhlbWUoYXhpcy50ZXh0LnggPSBlbGVtZW50X3RleHQoYW5nbGUgPSA5MCwgc2l6ZSA9IDcpKQpgYGAKIVtfRXN0aW1hdGVzIG9mIHJlZ3Jlc3Npb24gY29lZmZpY2llbnRzIGJ5IGEgcGVuYWxpemVkIHNlbWlwYXJhbWV0cmljIEJheWVzaWFuIENveCBtb2RlbCB3aXRoIEVsYXN0aWMgTmV0IHByaW9yLiBTb2xpZCBkb3RzIGluZGljYXRlIHRoZSBwb3N0ZXJpb3IgbWVhbiBvdmVyIE1DTUMgaXRlcmF0aW9ucyAoZXhjbHVkaW5nIGJ1cm4taW4gcGVyaW9kKSwgYW5kIHZlcnRpY2xlIGxpbmVzIHNob3cgdGhlIGNvcnJlc3BvbmRpbmcgOTUlIGNyZWRpYmlsaXR5IGludGVydmFscy5fXShmaWcvVENHQV9iYXllc0VOLnBuZyl7d2lkdGg9NjAlfQoKQSBwZW5hbGl6ZWQgc2VtaXBhcmFtZXRyaWMgQmF5ZXNpYW4gQ294IG1vZGVsIHdpdGggZG91YmxlIGV4cG9uZW50aWFsIHNwaWtlLWFuZC1zbGFiIHByaW9yIGlzIGltcGxlbWVudGVkIGluIHRoZSBgUmAgcGFja2FnZSBbKipCaEdMTSoqXShodHRwczovL2dpdGh1Yi5jb20vbnlpdWFiL0JoR0xNLmdpdCkgW0BZaTIwMTldLiBOb3RlIHRoYXQgKipCaEdMTSoqIHByb3ZpZGVzIGZyZXF1ZW50aXN0IGNvbmZpZGVuY2UgaW50ZXJ2YWxzIG9mIHRoZSBwb3N0ZXJpb3IgbW9kZSBvZiB0aGUgY29lZmZpY2llbnRzLgoKYGBge3J9CiMgcGVuYWxpemVkIHNlbWlwYXJhbWV0cmljIEJheWVzaWFuIENveCBtb2RlbCB3aXRoIChkb3VibGUgZXhwb25lbnRpYWwpIHNwaWtlLWFuZC1zbGFiIHByaW9yCnlfc3VydiA9IFN1cnYoY2xpbiR0aW1lLCBjbGluJHN0YXR1cykKeF9kYXRhZnJhbWUgPSBhcy5kYXRhLmZyYW1lKHgpCnNldC5zZWVkKDEyMykKQmF5ZXNmaXQgPSBCaEdMTTo6YmNveHBoKHlfc3VydiB+IC4sIHhfZGF0YWZyYW1lLCBwcmlvciA9IG1kZSgwLCAwLjAxLCAwLjgpLCBjb250cm9sID0gY294cGguY29udHJvbChpdGVyLm1heCA9IDIwMCkpCkJoR0xNOjpwbG90LmJoKEJheWVzZml0LCBjb2wucHRzID0gYygicmVkIiwgImJsdWUiKSwgbWFpbiA9ICJDb3ggd2l0aCBtaXh0dXJlIGRvdWJsZSBleHBvbmVudGlhbFxuIikgCmBgYAohW19Db2VmZmljaWVudCBlc3RpbWF0ZXMgb2YgYSBwZW5hbGl6ZWQgc2VtaXBhcmFtZXRyaWMgQmF5ZXNpYW4gQ294IG1vZGVsIHdpdGggKGRvdWJsZSBleHBvbmVudGlhbCkgc3Bpa2UtYW5kLXNsYWIgcHJpb3IuIFNvbGlkIGRvdHMgZGVub3RlIHRoZSBwb3N0ZXJpb3IgbW9kZSBvZiB0aGUgY29lZmZpY2llbnRzIGFuZCBsaW5lcyBkZW5vdGUgdGhlIDk1JSBjb25maWRlbmNlIGludGVydmFscy4gUmVkIGNvbG9yZWQgdGV4dCBvbiB0aGUgcmlnaHQgc2lkZSBtYXJrIHRoZSBzaWduaWZpY2FudCBmZWF0dXJlcyB3aXRoICRwIDwgMC4wNSQuX10oZmlnL1RDR0FfYmF5ZXNTcGlrZVNsYWIucG5nKXt3aWR0aD02MCV9CgoKIyBTdXJ2aXZhbCBtb2RlbCB2YWxpZGF0aW9uCgpUaGUgaWRlYWwgZXZhbHVhdGlvbiBvZiBhIHByb2dub3N0aWMgbW9kZWwgaXMgYmFzZWQgb24gY29tcGxldGVseSBpbmRlcGVuZGVudCB2YWxpZGF0aW9uIGRhdGEuIApJZiB0aGVyZSBhcmUgbm8gaW5kZXBlbmRlbnQgdmFsaWRhdGlvbiBkYXRhLCBpdCBpcyByZWNvbW1lbmRlZCB0byB1c2UgcmVzYW1wbGluZy1iYXNlZCBtZXRob2RzIGZvciBlc3RpbWF0aW5nIHRoZSAqKnVuY2VydGFpbnR5Kiogb2YgdGhlIG1vZGVs4oCZcyBwcmVkaWN0aW9uIHBlcmZvcm1hbmNlLiAKVGhpcyBjYW4gYmUgZG9uZSBmb3IgZXhhbXBsZSBieSByZXBlYXRlZGx5IHNwbGl0dGluZyB0aGUgZGF0YXNldCB0byB0cmFpbmluZy92YWxpZGF0aW9uIHNldHMgYW5kIGV2YWx1YXRpbmcgYSBtb2RlbOKAmXMgcGVyZm9ybWFuY2Ugb24gdGhlIGRpZmZlcmVudCB2YWxpZGF0aW9uIHNldHMgdXNpbmcgdmFyaW91cyBldmFsdWF0aW9uIG1ldHJpY3MuCgpUbyBldmFsdWF0ZSBhIHByb2dub3N0aWMgbW9kZWwsIHRoZXJlIGV4aXN0IHNldmVyYWwgcGVyZm9ybWFuY2UgbWV0cmljcy4KVGhlc2UgY2FuIGJlICp0aW1lLWRlcGVuZGVudCogb3IgKnRpbWUtaW5kZXBlbmRlbnQqLCB3aXRoIHRoZSB0aW1lLWRlcGVuZGVudCBtZXRyaWNzIGJlaW5nIG1vcmUgaW5mb3JtYXRpdmUgaW4gZ2VuZXJhbCBjb21wYXJlZCB0byBpbnRlZ3JhdGVkIG1lYXN1cmVzIChpLmUuIGV2YWx1YXRlZCBhY3Jvc3MgbWFueSB0aW1lIHBvaW50cykuCkZvciBzdXJ2aXZhbCBkYXRhLCB3ZSBjYW4gYXNzZXNzIHRoZSAqKmRpc2NyaW1pbmF0b3J5IHBvd2VyKiogb2YgYSBtb2RlbCAoaS5lLiBob3cgd2VsbCBkb2VzIGl0IHJhbmtzIHBhdGllbnRzKSBvciBob3cgd2VsbCBhIG1vZGVsIGlzICoqY2FsaWJyYXRlZCoqIChpLmUuIGhvdyBjbG9zZWx5IHRoZSBwcmVkaWN0ZWQgc3Vydml2YWwgcHJvYmFiaWxpdGllcyBhZ3JlZSBudW1lcmljYWxseSB3aXRoIHRoZSBhY3R1YWwgc3Vydml2YWwgb3V0Y29tZXMpLgpGb3IgZXhhbXBsZSwgbWVhc3VyZXMgc3VjaCBhcyB0aGUgKGludGVncmF0ZWQpIGFyZWEgdW5kZXIgdGltZS1zcGVjaWZpYyBST0MgY3VydmVzICgqKkFVQyoqLCBASGVhZ2VydHkyMDA1KSBhbmQgdGhlIGNvbmNvcmRhbmNlIGluZGV4ICgqKkMtaW5kZXgqKiwgQEhhcnJlbGwxOTgyKSBhcmUgbWVhc3VyZXMgb2YgZGlzY3JpbWluYXRpb24sIHdoaWxlIHRoZSByaWdodC1jZW5zb3JlZCBsb2dhcml0aG1pYyBsb3NzICgqKlJDTEwqKiwgQEF2YXRpMjAyMCkgaXMgYSBtZWFzdXJlIG9mIGNhbGlicmF0aW9uLgpUaGUgd2VsbC1rbm93biBCcmllciBzY29yZSBbQEdyYWYxOTk5XSBpcyB1c2VkIHRvIGV2YWx1YXRlIGJvdGggZGlzY3JpbWluYXRpb24gYW5kIGNhbGlicmF0aW9uIHBlcmZvcm1hbmNlLgoKRm9yIG9uZSBzcGxpdCBvZiB0cmFpbi92YWxpZGF0aW9uIGRhdGEgc2V0cywgb25lIGNhbiBlc3RpbWF0ZSBhIHN1cnZpdmFsIGRpc2NyaW1hdGlvbiBvciBjYWxpYnJhdGlvbiBtZXRyaWMgYmFzZWQgb24gZWl0aGVyIHRoZSB0cmFpbmluZyBvciB2YWxpZGF0aW9uIGRhdGEgc2V0LCBzdWNoIGFzIEFVQywgQy1pbmRleCBhbmQgQnJpZXIgc2NvcmUgYW5kIHRoZWlyIGNvcnJlc3BvbmRpbmcgdGltZS1kZXBlbmRlbnQgbWV0cmljcywgc2VlIHRoZSB0YWJsZSBiZWxvdy4KU2luY2UgaGlnaC1kaW1lbnNpb25hbCBzdXJ2aXZhbCBtb2RlbHMgYnVpbHQgb24gdGhlIHRyYWluaW5nIGRhdGEgY2FuIGJlIG92ZXJmaXR0ZWQsIHRoZSBjb25jbHVzaW9uIHNob3VsZCBiZSBkcmF3biBiYXNlZCBvbiB0aGUgZXZhbHVhdGlvbiBmcm9tIHRoZSB2YWxpZGF0aW9uIGRhdGEuCgpgYGB7ciB0YWJsZSwgZWNobz1GQUxTRSwgbWVzc2FnZT1GQUxTRSwgd2FybmluZ3M9RkFMU0UsIHJlc3VsdHM9J2FzaXMnfQp0YWJsID0gIgogICAgICAgICAgICAgICAgICAgICAgVHJhaW5pbmcgZGF0YSAgICAgICAgICAgICAgICAgICBWYWxpZGF0aW9uIGRhdGEgICAgICAgCiAgICAgICAgICAgIHwtLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS06fC0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLTp8CiAgICAgICAgICAgIHwgVGltZS1kZXBlbmRlbnQgIHwgSW50ZWdyYXRlZCAgfCBUaW1lLWRlcGVuZGVudCAgfCBJbnRlZ3JhdGVkICB8CiAgICAgICAgICAgIHwtLS0tLS0tLS0tLS0tLS0tLXw6LS0tLS0tLS0tLS06fC0tLS0tLS0tLS0tLS0tLS0tfDotLS0tLS0tLS0tLTp8CkFVQyAgICAgICAgIHwgICAgICAgXHUyNzEzICAgICAgICAgfCAgICAgIFx1MjcxMyAgICAgIHwgICAgICAgXHUyNzEzICAgICAgICAgfCAgICAgIFx1MjcxMyAgICAgIHwKQy1pbmRleCAgICAgfCAgICAgICBcdTI3MTMgICAgICAgICB8ICAgICAgXHUyNzEzICAgICAgfCAgICAgICBcdTI3MTMgICAgICAgICB8ICAgICAgXHUyNzEzICAgICAgfApCcmllciBzY29yZSB8ICAgICAgIFx1MjcxMyAgICAgICAgIHwgICAgICBcdTI3MTMgICAgICB8ICAgICAgIFx1MjcxMyAgICAgICAgIHwgICAgICBcdTI3MTMgICAgICB8CiIKY2F0KHRhYmwpICMgb3V0cHV0IHRoZSB0YWJsZSBpbiBhIGZvcm1hdCBnb29kIGZvciBIVE1ML1BERi9kb2N4IGNvbnZlcnNpb24KYGBgCmBgYAogICAgICAgICAgICAgICAgICAgICAgVHJhaW5pbmcgZGF0YSAgICAgICAgICAgICAgICAgICBWYWxpZGF0aW9uIGRhdGEgICAgICAgCiAgICAgICAgICAgIHwtLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS06fC0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLTp8CiAgICAgICAgICAgIHwgVGltZS1kZXBlbmRlbnQgIHwgSW50ZWdyYXRlZCAgfCBUaW1lLWRlcGVuZGVudCAgfCBJbnRlZ3JhdGVkICB8CiAgICAgICAgICAgIHwtLS0tLS0tLS0tLS0tLS0tLXw6LS0tLS0tLS0tLS06fC0tLS0tLS0tLS0tLS0tLS0tfDotLS0tLS0tLS0tLTp8CkFVQyAgICAgICAgIHwgICAgICAg4pyTICAgICAgICAgfCAgICAgIOKckyAgICAgIHwgICAgICAg4pyTICAgICAgICAgfCAgICAgIOKckyAgICAgIHwKQy1pbmRleCAgICAgfCAgICAgICDinJMgICAgICAgICB8ICAgICAg4pyTICAgICAgfCAgICAgICDinJMgICAgICAgICB8ICAgICAg4pyTICAgICAgfApCcmllciBzY29yZSB8ICAgICAgIOKckyAgICAgICAgIHwgICAgICDinJMgICAgICB8ICAgICAgIOKckyAgICAgICAgIHwgICAgICDinJMgICAgICB8CmBgYAoKIyMgTW9kZWwgZXZhbHVhdGlvbiAoY2xhc3NpYykgey19Cgo6Ojp7LmdyZWVuLWJveH0KJ0NsYXNzaWMnIGhlcmUgcmVmZXJzIHRvIHRoZSB1c2Ugb2YgbWFudWFsIGBSYCBjb2RlIGluIGNvbWJpbmF0aW9uIHdpdGggbWFueSBzZXBhcmF0ZSBgUmAgcGFja2FnZXMgd2hpY2ggaGF2ZSBiZWVuIHJvdXRpbmVseSB1c2VkIGluIGFjYWRlbWlhIHRoZSBsYXRlc3QgMTArIHllYXJzIGZvciBldmFsdWF0aW5nIHN1cnZpdmFsIG1vZGVscy4KOjo6CgpUbyBldmFsdWF0ZSB0aGUgcGVyZm9ybWFuY2Ugb2YgYSBzdGF0aXN0aWNhbCBtb2RlbCwgd2UgZmlyc3Qgc3BsaXQgdGhlIGRhdGEgaW50byB0cmFpbmluZyBhbmQgdmFsaWRhdGlvbiBkYXRhIHNldHMuCkZvciBleGFtcGxlLCB3ZSBjYW4gcmFuZG9tbHkgc3BsaXQgdGhlIDEwNDcgQlJDQSBwYXRpZW50cyBmcm9tIFRDR0EgaW50byAkODBcJSQgYXMgdHJhaW5pbmcgc2V0IGFuZCAkMjBcJSQgYXMgdmFsaWRhdGlvbiBzZXQuCgpgYGB7cn0Kc2V0LnNlZWQoMTIzKQpuID0gbnJvdyh4KQppZHggPSBzYW1wbGUoMTpuLCBuICogMC44LCByZXBsYWNlID0gRkFMU0UpCnhfdHJhaW4gPSB4W2lkeCwgXQp5X3RyYWluID0geVtpZHgsIF0KeF92YWxpZGF0ZSA9IHhbLWlkeCwgXQp5X3ZhbGlkYXRlID0geVstaWR4LCBdCmBgYAoKOjo6ey5pbmZvLWJveCAubm90ZX0KVGhlICQyMFwlJCBzcGxpdCBvZiBhIGRhdGFzZXQgaXMgb2Z0ZW4gbm90IGNvbnNpZGVyZWQgYW4gKippbmRlcGVuZGVudCoqIGRhdGFzZXQgYW5kICoqcmVzYW1wbGluZy1iYXNlZCBtZXRob2RzKiogc2hvdWxkIGJlIHVzZWQgaW4gc3VjaCBjYXNlcyB0byBwcm92aWRlIGFuIHVuYmlhc2VkIGVzdGltYXRlIG9mIHRoZSBwcmVkaWN0aXZlIGFjY3VyYWN5IG9mIGEgcHJvZ25vc3RpYyBtb2RlbC4KOjo6CgojIyMgRGlzY3JpbWluYXRpb24gbWV0cmljcyB7LX0KCjxmb250IHNpemU9IjQiPiAqKkdvb2RuZXNzLW9mLWZpdCoqIDwvZm9udD4gCgpUaGUgc2ltcGxlc3Qgd2F5IHRvIGRlbW9uc3RyYXRlIHRoZSBwcm9nbm9zdGljIHBvd2VyIG9mIGEgc3Vydml2YWwgbW9kZWwgaXMgdG8gZGljaG90b21pemUgdGhlIHByb2dub3N0aWMgc2NvcmVzIChpLmUuLCBsaW5lYXIgcHJlZGljdG9yICRscCQgaW4gdGhlIENveCBtb2RlbCkgYnkgbWVkaWFuIHZhbHVlLCBhbmQgdGhlbiB0byB1c2UgYSBsb2ctcmFuayB0ZXN0IHRvIGNvbXBhcmUgdGhlIHN1cnZpdmFsIGN1cnZlcyBvZiB0aGUgcGF0aWVudHMgaW4gdGhlIHR3byBncm91cHMuCldlIHVzZSB0aGUgYnVpbHQgbW9kZWwgdG8gcHJlZGljdCB0aGUgcHJvZ25vc3RpYyBzY29yZXMgYmFzZWQgb24gdGhlICQyMFwlJCB2YWxpZGF0aW9uIGRhdGEuClRoZSBmb2xsb3dpbmcgY29kZSBzaG93cyB0aGUgKipnb29kbmVzcy1vZi1maXQqKiBvZiBhIExhc3NvIENveCBtb2RlbCB3aXRoIHRoZSBCUkNBIHBhdGllbnRzIHN1cnZpdmFsIGFuZCBQQU01MCBtUk5BLVNlcSBkYXRhIGZyb20gVENHQS4KCmBgYHtyfQojIHRyYWluIGEgTGFzc28gQ294IG1vZGVsLCBzaW1pbGFybHkgZm9yIG90aGVyIENveC10eXBlIG1vZGVscwpzZXQuc2VlZCgxMjMpCmN2Zml0ID0gY3YuZ2xtbmV0KHhfdHJhaW4sIHlfdHJhaW4sIGZhbWlseSA9ICJjb3giLCBuZm9sZHMgPSA1LCBwZW5hbHR5LmZhY3RvciA9IHBmKQpwcmVkX2xwID0gcHJlZGljdChjdmZpdCwgbmV3eCA9IHhfdmFsaWRhdGUsIHMgPSBjdmZpdCRsYW1iZGEubWluLCB0eXBlID0gImxpbmsiKQoKIyBkaWNob3RvbWl6ZSBieSBwcm9nbm9zdGljIHNjb3JlcyAobGluZWFyIHByZWRpY3RvcikgIGJ5IG1lZGlhbiB0byBkaXZpZGUgdGhlIHZhbGlkYXRpb24gcGF0aWVudHMgaW50byB0d28gZ3JvdXBzCmdyb3VwX2RpY2hvdG9taXplID0gYXMubnVtZXJpYyhwcmVkX2xwID4gbWVkaWFuKHByZWRfbHApKQoKIyBkcmF3IHR3byBzdXJ2aXZhbCBjdXJ2ZXMgYmFzZWQgb24gS00gZXN0aW1hdGlvbiBhbmQgY29tcGFyZSB0aGVtIGJ5IGEgbG9nLXJhbmsgdGVzdApkYXRfdG1wID0gZGF0YS5mcmFtZSh0aW1lID0geV92YWxpZGF0ZVssIDFdLCBzdGF0dXMgPSB5X3ZhbGlkYXRlWywgMl0sIGdyb3VwID0gZ3JvdXBfZGljaG90b21pemUpCnNmaXQgPSBzdXJ2Zml0KFN1cnYodGltZSwgc3RhdHVzKSB+IGdyb3VwLCBkYXRhID0gZGF0X3RtcCkKCmdnc3VydiA9IGdnc3VydnBsb3Qoc2ZpdCwgY29uZi5pbnQgPSBUUlVFLCByaXNrLnRhYmxlID0gVFJVRSwgCiAgICAgICAgICAgeGxhYiA9ICJUaW1lIHNpbmNlIGRpYWdub3NpcyAoeWVhcikiLCBsZWdlbmQgPSBjKC4yLC4zKSwKICAgICAgICAgICBsZWdlbmQubGFicyA9IGMoIkxvdyByaXNrIiwgIkhpZ2ggcmlzayIpLCBsZWdlbmQudGl0bGUgPSAiRGljaG90b21pemVkIGdyb3VwcyIsICAKICAgICAgICAgICByaXNrLnRhYmxlLnkudGV4dC5jb2wgPSBUUlVFLCByaXNrLnRhYmxlLnkudGV4dCA9IEZBTFNFKQpnZ3N1cnYkcGxvdCA9IGdnc3VydiRwbG90ICsgCiAgYW5ub3RhdGUoInRleHQiLCB4ID0gMi42LCB5ID0gLjAzLCBsYWJlbD0gcGFzdGUwKCJMb2ctcmFuayB0ZXN0OlxuIiwgc3Vydl9wdmFsdWUoc2ZpdCkkcHZhbC50eHQpKQpnZ3N1cnYkdGFibGUgPSBnZ3N1cnYkdGFibGUgKyBsYWJzKHkgPSAiRGljaG90b21pemVkXG4gZ3JvdXBzIikKZ2dzdXJ2CmBgYAohW19LYXBsYW4tTWVpZXIgY3VydmVzIG9mIHRoZSBCUkNBIHBhdGllbnRzIGRhdGEgZGljaG90b21pemVkIGJ5IHRoZSBtZWRpYW4gb2YgcHJvZ25vc3RpYyBzY29yZXMgKGNhbGN1bGF0ZWQgZnJvbSB0aGUgTGFzc28gQ294IG1vZGVsIHdpdGggcGF0aWVudHMnIHN1cnZpdmFsIGFuZCBtUk5BLVNlcSBkYXRhKSBpbnRvIHR3byBncm91cHMuIFRoZSBsb2ctcmFuayB0ZXN0IGlzIHRvIGNvbXBhcmUgdGhlIHR3byBzdXJ2aXZhbCBkaXN0cmlidXRpb25zIGNvcnJlc3BvbmRpbmcgdG8gdGhlIHR3byBncm91cHMgb2YgcGF0aWVudHMuX10oZmlnL1RDR0Ffc3Vydl9rbV9sYXNzby5wbmcpe3dpZHRoPTYwJX0KClRoZSBwcm9nbm9zdGljIHNjb3JlcyBjYW4gYWxzbyBiZSBkaXZpZGVkIGludG8gdGhyZWUgb3IgbW9yZSBncm91cHMgYmFzZWQgb24gcXVhbnRpbGVzIGFuZCB0aGUgbG9nLXJhbmsgdGVzdCBjYW4gYmUgdXNlZCB0byBjb21wYXJlIHRoZSBkaWZmZXJlbmNlIG9mIG11bHRpcGxlIHN1cnZpdmFsIGN1cnZlcy4KCmBgYHtyfQpncm91cCA9IHByZWRfbHAKZ3JvdXBbcHJlZF9scCA+PSBxdWFudGlsZShwcmVkX2xwLCAyLzMpXSA9IDMKZ3JvdXBbcHJlZF9scCA+PSBxdWFudGlsZShwcmVkX2xwLCAxLzMpICYgcHJlZF9scCA8IHF1YW50aWxlKHByZWRfbHAsIDIvMyldID0gMgpncm91cFtwcmVkX2xwIDwgcXVhbnRpbGUocHJlZF9scCwgMS8zKV0gPSAxCgojIGRyYXcgdHdvIHN1cnZpdmFsIGN1cnZlcyBiYXNlZCBvbiBLTSBlc3RpbWF0aW9uIGFuZCBjb21wYXJlIHRoZW0gYnkgYSBsb2ctcmFuayB0ZXN0CmRhdF90bXAgPSBkYXRhLmZyYW1lKHRpbWUgPSB5X3ZhbGlkYXRlWywgMV0sIHN0YXR1cyA9IHlfdmFsaWRhdGVbLCAyXSwgZ3JvdXAgPSBncm91cCkKc2ZpdCA9IHN1cnZmaXQoU3Vydih0aW1lLCBzdGF0dXMpIH4gZ3JvdXAsIGRhdGEgPSBkYXRfdG1wKQoKZ2dzdXJ2ID0gZ2dzdXJ2cGxvdChzZml0LCBjb25mLmludCA9IFRSVUUsIHJpc2sudGFibGUgPSBUUlVFLCAKICAgICAgICAgICB4bGFiID0gIlRpbWUgc2luY2UgZGlhZ25vc2lzICh5ZWFyKSIsIGxlZ2VuZCA9IGMoLjIsLjMpLAogICAgICAgICAgIGxlZ2VuZC5sYWJzID0gYygiTG93IHJpc2siLCAiTWlkZGxlIHJpc2siLCAiSGlnaCByaXNrIiksIGxlZ2VuZC50aXRsZSA9ICJHcm91cHMiLCAgCiAgICAgICAgICAgcmlzay50YWJsZS55LnRleHQuY29sID0gVFJVRSwgcmlzay50YWJsZS55LnRleHQgPSBGQUxTRSkKZ2dzdXJ2JHBsb3QgPSBnZ3N1cnYkcGxvdCArIAogIGFubm90YXRlKCJ0ZXh0IiwgeCA9IDMuNSwgeSA9IC4wNSwgbGFiZWw9IHBhc3RlMCgiTG9nLXJhbmsgdGVzdDpcbiIsIHN1cnZfcHZhbHVlKHNmaXQpJHB2YWwudHh0KSkKZ2dzdXJ2CmBgYAohW19LYXBsYW4tTWVpZXIgY3VydmVzIG9mIHRoZSBCUkNBIHBhdGllbnRzIGRhdGEgZGl2aWRlZCBieSAzMyUgYW5kIDY3JSBxdWFudGlsZXMgb2YgcHJvZ25vc3RpYyBzY29yZXMgKGNhbGN1bGF0ZWQgZnJvbSB0aGUgTGFzc28gQ294IG1vZGVsIHdpdGggcGF0aWVudHMnIHN1cnZpdmFsIGFuZCBtUk5BLVNlcSBkYXRhKSBpbnRvIHRocmVlIGdyb3Vwcy4gVGhlIGxvZy1yYW5rIHRlc3QgaXMgdG8gY29tcGFyZSB0aGUgdHdvIHN1cnZpdmFsIGRpc3RyaWJ1dGlvbnMgY29ycmVzcG9uZGluZyB0byB0aGUgdGhyZWUgZ3JvdXBzIG9mIHBhdGllbnRzLl9dKGZpZy9UQ0dBX3N1cnZfa21fbGFzc28yLnBuZyl7d2lkdGg9NjAlfQoKPGZvbnQgc2l6ZT0iNCI+ICoqVGltZS1kZXBlbmRlbnQgQVVDKiogPC9mb250PiAKClRoZSBgUmAgcGFja2FnZSBbKipyaXNrc2V0Uk9DKipdKGh0dHBzOi8vQ1JBTi5SLXByb2plY3Qub3JnL3BhY2thZ2U9cmlza3NldFJPQykgW0BIZWFnZXJ0eTIwMDVdIGNhbiBlc3RpbWF0ZSBib3RoIHRpbWUtZGVwZW5kZW50IGFuZCBpbnRlZ3JhdGVkIEFVQy4KV2UgZGVtb25zdHJhdGUgdGhlIGNhbGN1bGF0aW9uIGJhc2VkIG9uIGJvdGggdHJhaW5pbmcgYW5kIHZhbGlkYXRpb24gZGF0YS4KCjo6OnsuaW5mby1ib3ggLm5vdGV9CkEgQ294IHByb3BvcnRpb25hbCBoYXphcmRzIG1vZGVsIChhbmQgTGFzc28gQ294IGFzIGEgY29uc2VxdWVuY2UpIGlzIGEgc2VtaS1wYXJhbWV0cmljIG1vZGVsLCB3aGljaCBtZWFucyB0aGF0IGl0IGRvZXMgbm90IHByb2R1Y2Ugc3Vydml2YWwgZGlzdHJpYnV0aW9uIHByZWRpY3Rpb25zIGJ5IGRlZmF1bHQuCkhvd2V2ZXIsIHVzaW5nIHRoZSBmdW5jdGlvbiBgcmlza3NldFJPQzo6Q294V2VpZ2h0cygpYCB5b3UgY2FuIHRyYW5zZm9ybSB0aGUgYGN2LmdsbW5ldGAncyBvdXRwdXQgbGluZWFyIHByZWRpY3RvcnMgKGBscGApIHRvIHN1cnZpdmFsIGRpc3RyaWJ1dGlvbiBwcmVkaWN0aW9ucy4KVGhpcyB0cmFuc2Zvcm1hdGlvbiBpbnRlcm5hbGx5IHVzZXMgdGhlIEJyZXNsb3cgZXN0aW1hdG9yIGZvciB0aGUgY3VtdWxhdGl2ZSBiYXNlbGluZSBoYXphcmQuCjo6OgoKYGBge3J9CiMgdW5pcXVlIGV2ZW50IHRpbWVzIGZvciBwYXRpZW50cyBpbiB0aGUgdHJhaW5pbmcgYW5kIHZhbGlkYXRpb24gZGF0YSBzZXRzCnV0aW1lc190cmFpbiA9IHNvcnQodW5pcXVlKHlfdHJhaW5beV90cmFpblssIDJdID09IDEsIDFdKSkKdXRpbWVzX3ZhbGlkYXRlID0gc29ydCh1bmlxdWUoeV92YWxpZGF0ZVt5X3ZhbGlkYXRlWywgMl0gPT0gMSwgMV0pKQoKIyBtYXJrZXJzIGZyb20gdGhlIGVzdGltYXRlZCBsaW5lYXIgcHJlZGljdG9ycyBvZiBhIExhc3NvIENveCBtb2RlbApwcmVkX2xwX3RyYWluID0gcHJlZGljdChjdmZpdCwgbmV3eCA9IHhfdHJhaW4sIHMgPSBjdmZpdCRsYW1iZGEubWluLCB0eXBlID0gImxpbmsiKQpwcmVkX2xwX3ZhbGlkYXRlID0gcHJlZGljdChjdmZpdCwgbmV3eCA9IHhfdmFsaWRhdGUsIHMgPSBjdmZpdCRsYW1iZGEubWluLCB0eXBlID0gImxpbmsiKQoKIyMgY29tcHV0ZSB0aW1lLWRlcGVuZGVudCBBVUMKQVVDX3RyYWluID0gcmVwKE5BLCBsZW5ndGgodXRpbWVzX3RyYWluKSkKQVVDX3ZhbGlkYXRlID0gcmVwKE5BLCBsZW5ndGgodXRpbWVzX3ZhbGlkYXRlKSkKZm9yIChqIGluIDE6bGVuZ3RoKHV0aW1lc190cmFpbikpIHsKICBvdXQgPSByaXNrc2V0Uk9DOjpDb3hXZWlnaHRzKG1hcmtlciA9IHByZWRfbHBfdHJhaW4sIFN0aW1lID0geV90cmFpblssIDFdLCAKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHN0YXR1cyA9IHlfdHJhaW5bLCAyXSwgcHJlZGljdC50aW1lID0gdXRpbWVzX3RyYWluW2pdKQogIEFVQ190cmFpbltqXSA9IG91dCRBVUMKfQpmb3IgKGogaW4gMTpsZW5ndGgodXRpbWVzX3ZhbGlkYXRlKSkgewogIG91dCA9IHJpc2tzZXRST0M6OkNveFdlaWdodHMobWFya2VyID0gcHJlZF9scF92YWxpZGF0ZSwgU3RpbWUgPSB5X3ZhbGlkYXRlWywgMV0sIAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgc3RhdHVzID0geV92YWxpZGF0ZVssIDJdLCBwcmVkaWN0LnRpbWUgPSB1dGltZXNfdmFsaWRhdGVbal0pCiAgQVVDX3ZhbGlkYXRlW2pdID0gb3V0JEFVQwp9CgojIGRyYXcgdGhlIHRpbWUtZGVwZW5kZW50IEFVQyBmcm9tIHRoZSB0cmFpbmluZyBhbmQgdmFsaWRhdGlvbiBkYXRhIHNldHMKZGF0X0FVQyA9IGRhdGEuZnJhbWUodEFVQyA9IGMoQVVDX3RyYWluLCBBVUNfdmFsaWRhdGUpLCAKICAgICAgICAgICAgICAgICAgICAgIHRpbWVzID0gYyh1dGltZXNfdHJhaW4sIHV0aW1lc192YWxpZGF0ZSksCiAgICAgICAgICAgICAgICAgICAgICBncm91cCA9IGMocmVwKCJBVUNfdHJhaW4iLCBsZW5ndGgoQVVDX3RyYWluKSksIHJlcCgiQVVDX3ZhbGlkYXRlIiwgbGVuZ3RoKEFVQ192YWxpZGF0ZSkpKSkKZ2dwbG90KGRhdF9BVUMsIGFlcyh0aW1lcywgdEFVQywgZ3JvdXAgPSBncm91cCwgY29sb3IgPSBncm91cCkpICsgeGxhYigiRXZhbHVhdGlvbiB0aW1lIHBvaW50cyAoeWVhcikiKSArIHlsYWIoIkFVQyIpICsgeWxpbSgwLjUsIDEpICsKICBnZW9tX3N0ZXAoZGlyZWN0aW9uID0gInZoIikgKyB0aGVtZShsZWdlbmQucG9zaXRpb24gPSBjKDAuNywgMC44KSwgbGVnZW5kLnRpdGxlPWVsZW1lbnRfYmxhbmsoKSkKYGBgCiFbX1RpbWUtZGVwZW5kZW50IEFVQyBiYXNlZCBvbiBhIExhc3NvIENveCBtb2RlbCBhcHBsaWVkIHRvIHRoZSBCUkNBIHBhdGllbnRzIGRhdGEgZnJvbSBUQ0dBLiBUaGUgcmVkIGxpbmUgc2hvd3MgdGhlIFRpbWUtZGVwZW5kZW50IEFVQyBjYWxjdWxhdGVkIGZyb20gdGhlIDgwJSB0cmFpbmluZyBkYXRhLCBhbmQgdGhlIGdyZWVuIGxpbmUgc2hvd3MgdGhlIFRpbWUtZGVwZW5kZW50IEFVQyBjYWxjdWxhdGVkIGZyb20gdGhlIDIwJSB2YWxpZGF0aW9uIGRhdGEuX10oZmlnL1RDR0Ffc3Vydl9hdWNfbGFzc28ucG5nKXt3aWR0aD01MCV9Cgo8Zm9udCBzaXplPSI0Ij4gKipJbnRlZ3JhdGVkIEFVQyoqIDwvZm9udD4gCgpUaGUgYFJgIHBhY2thZ2UgWyoqcmlza3NldFJPQyoqXShodHRwczovL0NSQU4uUi1wcm9qZWN0Lm9yZy9wYWNrYWdlPXJpc2tzZXRST0MpIFtASGVhZ2VydHkyMDA1XSBwcm92aWRlcyBmdW5jdGlvbiBgSW50ZWdyYXRlQVVDKClgIHRvIGVzdGltYXRlIGludGVncmF0ZWQgQVVDLgoKYGBge3J9CiMgQmVmb3JlIGNvbXB1dGluZyBpbnRlZ3JhdGVkIEFVQywgZmlyc3QgZXN0aW1hdGUgc3Vydml2YWwgcHJvYmFiaWxpdGllcyBhdCB1bmlxdWUgc3Vydml2YWwgdGltZXMKc3Vydl9wcm9iX3RyYWluID0gdW5pcXVlKHN1cnZmaXQoU3Vydih5X3RyYWluWywgMV0sIHlfdHJhaW5bLCAyXSkgfiAxKSRzdXJ2KQpzdXJ2X3Byb2JfdmFsaWRhdGUgPSB1bmlxdWUoc3VydmZpdChTdXJ2KHlfdmFsaWRhdGVbLCAxXSwgeV92YWxpZGF0ZVssIDJdKSB+IDEpJHN1cnYpCgojIyBpbnRlZ3JhdGVkIEFVQyAoZS5nLiBvdmVyIHRtYXg9MTAgeWVhcnMpIHRvIGdldCBjb25jb3JkYW5jZSBtZWFzdXJlIGJhc2VkIG9uIHRyYWluaW5nIGRhdGEKKGlBVUNfdHJhaW4gPSByaXNrc2V0Uk9DOjpJbnRlZ3JhdGVBVUMoQVVDX3RyYWluLCB1dGltZXNfdHJhaW4sIHN1cnZfcHJvYl90cmFpbiwgdG1heCA9IDEwKSkKYGBgCmBgYApbMV0gMC42MjgxMzAxCmBgYApgYGB7cn0KIyMgaW50ZWdyYXRlZCBBVUMgKGUuZy4gb3ZlciB0bWF4PTEwIHllYXJzKSB0byBnZXQgY29uY29yZGFuY2UgbWVhc3VyZSBiYXNlZCBvbiB2YWxpZGF0aW9uIGRhdGEKKGlBVUNfdmFsaWRhdGUgPSByaXNrc2V0Uk9DOjpJbnRlZ3JhdGVBVUMoIEFVQ192YWxpZGF0ZSwgdXRpbWVzX3ZhbGlkYXRlLCBzdXJ2X3Byb2JfdmFsaWRhdGUsIHRtYXggPSAxMCkpCmBgYApgYGAKWzFdIDAuNjMxODg1NwpgYGAKCjxmb250IHNpemU9IjQiPiAqKlRpbWUtZGVwZW5kZW50IEMtaW5kZXgqKiA8L2ZvbnQ+IAoKVGhlIEMtaW5kZXggaXMgbm90IHByb3BlciBmb3IgJHQkLXllYXIgcHJlZGljdGlvbnMsIHNlZSBAQmxhbmNoZTIwMTkuCkNvbnNpZGVyIHVzaW5nIHRpbWUtZGVwZW5kZW50IEFVQyBvciB0aW1lLWRlcGVuZGVudCBCcmllciBzY29yZSBpbnN0ZWFkLgpGb3IgYSB0aW1lLWRlcGVuZGVudCBkaXNjcmltaW5hdGlvbiBpbmRleCBmb3Igc3Vydml2YWwgZGF0YSwgc2VlIEBBbnRvbGluaTIwMDUuCgo8Zm9udCBzaXplPSI0Ij4gKipDLWluZGV4KiogPC9mb250PiAKClRoZSBgUmAgcGFja2FnZSBbKipnbG1uZXQqKl0oaHR0cHM6Ly9DUkFOLlItcHJvamVjdC5vcmcvcGFja2FnZT1nbG1uZXQpIHByb3ZpZGVzIHRoZSBmdW5jdGlvbiBgZ2xtbmV0OjpDaW5kZXgoKWAgdG8gZXN0aW1hdGUgSGFycmVsbCdzIEMtaW5kZXggZnJvbSBhICJjb3huZXQiIG9iamVjdC4KVGhlIGBSYCBwYWNrYWdlIFsqKnN1cnZBVUMqKl0oaHR0cHM6Ly9DUkFOLlItcHJvamVjdC5vcmcvcGFja2FnZT1zdXJ2QVVDKSBwcm92aWRlcyB0aGUgZnVuY3Rpb24gYHN1cnZBVUM6OlVub0MoKWAgdG8gZXN0aW1hdGVkIFVubydzIEMtaW5kZXguClNlZSBhbiBleGFtcGxlIGNhbGN1bGF0aW9uIGZvciBib3RoIEMtaW5kZXhlcyB1c2luZyBhIExhc3NvIENveCBtb2RlbCBiZWxvdy4KCmBgYHtyfQpzZXQuc2VlZCgxMjMpCmN2Zml0ID0gY3YuZ2xtbmV0KHhfdHJhaW4sIHlfdHJhaW4sIGZhbWlseSA9ICJjb3giLCBuZm9sZHMgPSA1LCBwZW5hbHR5LmZhY3RvciA9IHBmKQpwcmVkID0gcHJlZGljdChjdmZpdCwgbmV3eCA9IHhfdmFsaWRhdGUsIHR5cGUgPSAicmVzcG9uc2UiLCBzID0gY3ZmaXQkbGFtYmRhLm1pbikKIyBIYXJyZWxsJ3MgQy1pbmRleAooQ2luZGV4X0hhcnJlbGwgPSBtZWFuKGFwcGx5KHByZWQsIDIsIENpbmRleCwgeSA9IHlfdmFsaWRhdGUpKSkKYGBgCmBgYApbMV0gMC43MzIwMjIxCmBgYApgYGB7cn0KIyBVbm8ncyBDLWluZGV4CihDaW5kZXhfVW5vID0gc3VydkFVQzo6VW5vQyh5X3RyYWluLCB5X3ZhbGlkYXRlLCBwcmVkKSkKYGBgCmBgYApbMV0gMC41Nzg2ODYxCmBgYAoKIyMjIENhbGlicmF0aW9uIG1ldHJpY3Mgey19Cgo8Zm9udCBzaXplPSI0Ij4gKipUaW1lLWRlcGVuZGVudCBCcmllciBzY29yZSoqIDwvZm9udD4gCgpUaGUgYFJgIHBhY2thZ2UgWyoqcmlza1JlZ3Jlc3Npb24qKl0oaHR0cHM6Ly9DUkFOLlItcHJvamVjdC5vcmcvcGFja2FnZT1yaXNrUmVncmVzc2lvbikgY2FuIGFzc2VzcyB0aGUgcHJlZGljdGlvbiBlcnJvciBjdXJ2ZXMgb2Ygc3Vydml2YWwgbW9kZWxzIGJhc2VkIG9uIHRoZSB0aW1lLWRlcGVuZGVudCBCcmllciBzY29yZS4KU2ltaWxhciB0byB0aGUgdGltZS1kZXBlbmRlbnQgQVVDLCBvbmUgbmVlZHMgdG8gZmlyc3QgY2FsY3VsYXRlIHRoZSBsaW5lYXIgcHJlZGljdG9ycyAoJGxwJCkgZnJvbSBhIGZyZXF1ZW50aXN0IG9yIEJheWVzaWFuIENveCBtb2RlbCwgYW5kIHRoZW4gdXNlIGBzdXJ2aXZhbDo6Y294cGgoKWAgdG8gcmVncmVzcyB0aGUgc3Vydml2YWwgb3V0Y29tZXMgb24gdGhlIGxpbmVhciBwcmVkaWN0b3IsIHdoaWNoIGlzIHByZXBhcmVkIGFzIGlucHV0IG9mIGByaXNrUmVncmVzc2lvbjo6U2NvcmUoKWAgdG8gZXN0aW1hdGUgdGhlICh0aW1lLWRlcGVuZGVudCkgQnJpZXIgc2NvcmUuCgpgYGB7cn0KIyMgdGltZS1kZXBlbmRlbnQgQnJpZXIgc2NvcmUKCiMgdXNlIHRoZSAoeF90cmFpbiwgeV90cmFpbikgODAlIHNhbXBsZXMgZm9yIHRyYWluaW5nCiMgYW5kIHRoZSAoeF92YWxpZGF0ZSwgeV92YWxpZGF0ZSkgMjAlIHNhbXBsZXMgZm9yIHRlc3RpbmcKCnlfdHJhaW5fc3VydiA9IFN1cnYoeV90cmFpblssInRpbWUiXSwgeV90cmFpblssInN0YXR1cyJdKQp5X3ZhbGlkYXRlX3N1cnYgPSBTdXJ2KHlfdmFsaWRhdGVbLCJ0aW1lIl0sIHlfdmFsaWRhdGVbLCJzdGF0dXMiXSkKc2V0LnNlZWQoMTIzKQpjdmZpdCA9IGN2LmdsbW5ldCh4X3RyYWluLCB5X3RyYWluX3N1cnYsIGZhbWlseSA9ICJjb3giLCBuZm9sZHMgPSA1LCBwZW5hbHR5LmZhY3RvciA9IHBmKQpscF90cmFpbiA9IHByZWRpY3QoY3ZmaXQsIG5ld3ggPSB4X3RyYWluLCBzID0gY3ZmaXQkbGFtYmRhLm1pbiwgdHlwZSA9ICJsaW5rIikKbHBfdmFsaWRhdGUgPSBwcmVkaWN0KGN2Zml0LCBuZXd4ID0geF92YWxpZGF0ZSwgcyA9IGN2Zml0JGxhbWJkYS5taW4sIHR5cGUgPSAibGluayIpCgojIHByZXBhcmUgZGF0YSBmb3JtYXQgc3VpdGVkIGZvciBmdW5jdGlvbiBTY29yZSgpIGZyb20gdGhlIHJpc2tSZWdyZXNzaW9uIHBhY2thZ2UKZGF0YV90cmFpbiA9IGRhdGEuZnJhbWUodGltZSA9IHlfdHJhaW5bLCJ0aW1lIl0sIHN0YXR1cyA9IHlfdHJhaW5bLCJzdGF0dXMiXSwgbHAgPSBhcy52ZWN0b3IobHBfdHJhaW4pKQpkYXRhX3ZhbGlkYXRlID0gZGF0YS5mcmFtZSh0aW1lID0geV92YWxpZGF0ZVssInRpbWUiXSwgc3RhdHVzID0geV92YWxpZGF0ZVssInN0YXR1cyJdLCBscCA9IGFzLnZlY3RvcihscF92YWxpZGF0ZSkpCmxhc3NvX3RyYWluID0gY294cGgoU3Vydih0aW1lLHN0YXR1cykgfiBscCwgZGF0YSA9IGRhdGFfdHJhaW4sIHk9VFJVRSwgeCA9IFRSVUUpCmxhc3NvX3ZhbGlkYXRlID0gY294cGgoU3Vydih0aW1lLHN0YXR1cykgfiBscCwgZGF0YSA9IGRhdGFfdmFsaWRhdGUsIHk9VFJVRSwgeCA9IFRSVUUpCgojIGNhbGN1bGF0ZSBCcmllciBzY29yZXMgYmFzZWQgb24gYm90aCB0cmFpbmluZyBhbmQgdmFsaWRhdGlvbiBkYXRhCkJyaWVyX3RyYWluID0gcmlza1JlZ3Jlc3Npb246OlNjb3JlKGxpc3QoIkJyaWVyX3RyYWluIiA9IGxhc3NvX3RyYWluKSwgZm9ybXVsYSA9IFN1cnYodGltZSwgc3RhdHVzKSB+IDEsIGRhdGEgPSBkYXRhX3RyYWluLCBjb25mLmludCA9IEZBTFNFLCBtZXRyaWNzID0gImJyaWVyIiwgc3VtbWFyeT0iaWJzIiwgdGltZXMgPSBzb3J0KHVuaXF1ZShkYXRhX3RyYWluJHRpbWUpKSkkQnJpZXIkc2NvcmUKQnJpZXJfdmFsaWRhdGUgPSByaXNrUmVncmVzc2lvbjo6U2NvcmUobGlzdCgiQnJpZXJfdmFsaWRhdGUiID0gbGFzc29fdmFsaWRhdGUpLCBmb3JtdWxhID0gU3Vydih0aW1lLCBzdGF0dXMpIH4gMSwgZGF0YSA9IGRhdGFfdmFsaWRhdGUsIGNvbmYuaW50ID0gRkFMU0UsIG1ldHJpY3MgPSAiYnJpZXIiLCBzdW1tYXJ5PSJpYnMiLCB0aW1lcyA9IHNvcnQodW5pcXVlKGRhdGFfdmFsaWRhdGUkdGltZSkpKSRCcmllciRzY29yZQpCcmllcl9zY29yZSA9IHJiaW5kKEJyaWVyX3RyYWluLCBCcmllcl92YWxpZGF0ZSkKQnJpZXJfc2NvcmUgPSBCcmllcl9zY29yZVtCcmllcl9zY29yZSRtb2RlbCAhPSAiTnVsbCBtb2RlbCIsIF0KICAKZ2dwbG90KEJyaWVyX3Njb3JlLCBhZXModGltZXMsIEJyaWVyLCBncm91cCA9IG1vZGVsLCBjb2xvciA9IG1vZGVsKSkgKyB4bGFiKCJFdmFsdWF0aW9uIHRpbWUgcG9pbnRzICh5ZWFyKSIpICsgeWxhYigiQnJpZXIgc2NvcmUiKSArIAogIGdlb21fc3RlcChkaXJlY3Rpb24gPSAidmgiKSArIHRoZW1lKGxlZ2VuZC5wb3NpdGlvbiA9IGMoMC4xNSwgMC44OCksIGxlZ2VuZC50aXRsZT1lbGVtZW50X2JsYW5rKCkpCmBgYAohW19UaW1lLWRlcGVuZGVudCBCcmllciBzY29yZSBiYXNlZCBvbiBhIExhc3NvIENveCBtb2RlbCBhcHBsaWVkIHRvIHRoZSBCUkNBIHBhdGllbnRzIGRhdGEgZnJvbSBUQ0dBLiBUaGUgcmVkIGxpbmUgc2hvd3MgdGhlIFRpbWUtZGVwZW5kZW50IEJyaWVyIHNjb3JlIGNhbGN1bGF0ZWQgZnJvbSB0aGUgODAlIHRyYWluaW5nIGRhdGEsIGFuZCB0aGUgZ3JlZW4gbGluZSBzaG93cyB0aGUgVGltZS1kZXBlbmRlbnQgQnJpZXIgc2NvcmUgY2FsY3VsYXRlZCBmcm9tIHRoZSAyMCUgdmFsaWRhdGlvbiBkYXRhLl9dKGZpZy9UQ0dBX3N1cnZfYnJpZXJfdF9sYXNzby5wbmcpe3dpZHRoPTYwJX0KCjxmb250IHNpemU9IjQiPiAqKkludGVncmF0ZWQgQnJpZXIgc2NvcmUgKElCUykqKiA8L2ZvbnQ+IAoKVGhlIGZ1bmN0aW9uIGByaXNrUmVncmVzc2lvbjo6U2NvcmUoKWAgYWxzbyBzdW1tYXJpemVzIElCUyB3aGVuIHNwZWNpZnlpbmcgYXJndW1lbnQgYHN1bW1hcnkgPSAiaWJzImAuCldlIGNhbiBleHRyYWN0IHRoZSBJQlMgY29ycmVzcG9uZGluZyB0byB0aGUgbGFyZ2VzdCBldmFsdWF0aW9uIHRpbWUgcG9pbnQuCgpgYGB7cn0KQnJpZXJfdmFsaWRhdGVfaWJzID0gQnJpZXJfdmFsaWRhdGVbQnJpZXJfdmFsaWRhdGUkbW9kZWwgPT0gIkJyaWVyX3ZhbGlkYXRlIiwgXQpCcmllcl92YWxpZGF0ZV9pYnMkSUJTW3doaWNoLm1heChCcmllcl92YWxpZGF0ZV9pYnMkdGltZXMpXQpgYGAKYGBgClsxXSAwLjE3MTE2MTcKYGBgCgojIyMgVW5jZXJ0YWludHkgUXVhbnRpZmljYXRpb24gey0jdXExfQoKOjo6ey5pbmZvLWJveCAuaW1wb3J0YW50fQoqKkl0IGlzIHJlY29tbWVuZGVkIHRvIHVzZSByZXNhbXBsaW5nLWJhc2VkIG1ldGhvZHMqKiBmb3IgZXN0aW1hdGluZyB0aGUgdW5jZXJ0YWludHkgb2YgdGhlIG1vZGVsJ3MgcGVyZm9ybWFuY2UsIGlmIHRoZXJlIGFyZSBubyAqKmluZGVwZW5kZW50KiogdmFsaWRhdGlvbiBkYXRhIGZvciBtb2RlbCBldmFsdWF0aW9uLgpUaGlzIGNhbiBiZSBkb25lIGZvciBleGFtcGxlIGJ5IHJlcGVhdGVkbHkgc3BsaXR0aW5nIHRoZSBkYXRhc2V0IHRvIHRyYWluaW5nL3ZhbGlkYXRpb24gc2V0cyBhbmQgZXZhbHVhdGluZyBhIG1vZGVsJ3MgcGVyZm9ybWFuY2Ugb24gdGhlIGRpZmZlcmVudCB2YWxpZGF0aW9uIHNldHMgdXNpbmcgdmFyaW91cyBkaXNjcmltaW5hdGlvbiBvciBjYWxpYnJhdGlvbiBtZXRyaWNzLgo6OjoKCldlIGRlbW9uc3RyYXRlIGhvdyB0byByYW5kb21seSBzcGxpdCB0aGUgZGF0YSwgZS5nLiAkMTAwJCB0aW1lcywgdHJhaW4gYSBMYXNzbyBDb3ggbW9kZWwgYW5kIGVzdGltYXRlIHRoZSBpbnRlZ3JhdGVkIEFVQyBiYXNlZCBvbiB0aGUgdmFsaWRhdGlvbiBkYXRhIGluIGVhY2ggcmVwbGljYXRpb24uCkZvciBvdGhlciBDb3gtdHlwZSBtb2RlbHMsIHdlIGNhbiBqdXN0IHJlcGxhY2UgdGhlIG1vZGVsIGZpdHRpbmcgcGFydCBgY3YuZ2xtbmV0KClgIChhbmQgYHByZWRpY3QoKWApIGluIHRoZSBgZm9yYCBsb29wIGJlbG93LgpIb3dldmVyLCBtb3N0IG9mIHRoZSBCYXllc2lhbiBDb3ggbW9kZWxzIGludHJvZHVjZWQgcHJldmlvdXNseSBhcmUgY29tcHV0YXRpb25hbGx5IHRpbWUtY29uc3VtaW5nIHdoZW4gcmFuZG9tbHkgc3BsaXR0aW5nIHRoZSBkYXRhIG1hbnkgdGltZXMuCgpgYGB7cn0KIyBzcGxpdCB0aGUgZGF0YSAxMDAgdGltZXMKc2V0LnNlZWQoMTIzKQprID0gMTAwCmlBVUMgPSByZXAoTkEsIGspCmZvciAoaSBpbiAxOmspIHsKICBpZHggPSBzYW1wbGUoMTpuLCBuICogMC44LCByZXBsYWNlID0gRkFMU0UpCiAgeF90cmFpbiA9IHhbaWR4LCBdCiAgeV90cmFpbiA9IHlbaWR4LCBdCiAgeF92YWxpZGF0ZSA9IHhbLWlkeCwgXQogIHlfdmFsaWRhdGUgPSB5Wy1pZHgsIF0KICBjdmZpdCA9IGN2LmdsbW5ldCh4X3RyYWluLCB5X3RyYWluLCBmYW1pbHkgPSAiY294IiwgbmZvbGRzID0gNSwgcGVuYWx0eS5mYWN0b3IgPSBwZikKICBwcmVkX2xwID0gcHJlZGljdChjdmZpdCwgbmV3eCA9IHhfdmFsaWRhdGUsIHMgPSBjdmZpdCRsYW1iZGEubWluLCB0eXBlID0gImxpbmsiKQogIHV0aW1lcyA9IHNvcnQodW5pcXVlKHlfdmFsaWRhdGVbeV92YWxpZGF0ZVssIDJdID09IDEsIDFdKSkKICBBVUMgPSByZXAoTkEsIGxlbmd0aCh1dGltZXMpKQogIGZvciAoaiBpbiAxOmxlbmd0aCh1dGltZXMpKSB7CiAgICBvdXQgPSBDb3hXZWlnaHRzKG1hcmtlciA9IHByZWRfbHAsIFN0aW1lID0geV92YWxpZGF0ZVssIDFdLCBzdGF0dXMgPSB5X3ZhbGlkYXRlWywgMl0sIHByZWRpY3QudGltZSA9IHV0aW1lc1tqXSkKICAgIEFVQ1tqXSA9IG91dCRBVUMKICB9CiAgc3Vydl9wcm9iID0gdW5pcXVlKHN1cnZmaXQoU3Vydih5X3ZhbGlkYXRlWywgMV0sIHlfdmFsaWRhdGVbLCAyXSkgfiAxKSRzdXJ2KQogIGlBVUNbaV0gPSBJbnRlZ3JhdGVBVUMoQVVDLCB1dGltZXMsIHN1cnZfcHJvYiwgdG1heCA9IDEwKQp9CmRhdF90bXAgPSBkYXRhLmZyYW1lKHggPSAiTGFzc28gQ294IiwgeSA9IGlBVUMpCgpzZXQuc2VlZCgxMjMpCmdncGxvdChkYXRfdG1wLCBhZXMoeCwgeSkpICsgZ2VvbV9ib3hwbG90KCkgKyB5bGltKDAuNSwgMSkgKyB4bGFiKCIiKSArIHlsYWIoIkludGVncmF0ZWQgQVVDIikgKwogIGdlb21faml0dGVyKGNvbG9yPSJibHVlIiwgc2l6ZSA9IDAuNSwgYWxwaGEgPSAwLjUpCmBgYAohW19JbnRlZ3JhdGVkIEFVQyBiYXNlZCBvbiByYW5kb21seSBzcGxpdCB2YWxpZGF0aW9uIGRhdGEgMTAwIHRpbWVzLiBUaGUgYmx1ZSBkb3RzIGFyZSB0aGUgMTAwIHZhbHVlcyBvZiBpbnRlZ3JhdGVkIEFVQy5fXShmaWcvVENHQV9zdXJ2X2lhdWNfbGFzc28ucG5nKXt3aWR0aD0zMCV9CgpTaW1pbGFyIHRvIG9idGFpbmluZyB1bmNlcnRhaW50eSBvZiB0aGUgaW50ZWdyYXRlZCBBVUMsIHdlIGNhbiBhbHNvIGVzdGltYXRlIHRoZSB1bmNlcnRhaW50eSBvZiB0aGUgQy1pbmRleCBmb3IgZXZhbHVhdGluZyB0aGUgZ2xvYmFsIHBlcmZvcm1hbmNlIG9mIG91ciBtb2RlbCdzIGRpc2NyaW1pbmF0aW9uLgoKYGBge3J9CiMgc3BsaXQgdGhlIGRhdGEgMTAwIHRpbWVzCnNldC5zZWVkKDEyMykKayA9IDEwMApDaW5kZXhfYWxsID0gZGF0YS5mcmFtZShIYXJyZWxsID0gcmVwKE5BLCBrKSwgVW5vID0gcmVwKE5BLCBrKSkKZm9yIChpIGluIDE6aykgewogIGlkeCA9IHNhbXBsZSgxOm4sIG4gKiAwLjgsIHJlcGxhY2UgPSBGQUxTRSkKICB4X3RyYWluID0geFtpZHgsIF0KICB5X3RyYWluID0geVtpZHgsIF0KICB4X3ZhbGlkYXRlID0geFstaWR4LCBdCiAgeV92YWxpZGF0ZSA9IHlbLWlkeCwgXQogIGN2Zml0ID0gY3YuZ2xtbmV0KHhfdHJhaW4sIHlfdHJhaW4sIGZhbWlseSA9ICJjb3giLCBuZm9sZHMgPSA1LCBwZW5hbHR5LmZhY3RvciA9IHBmKQogIHByZWQgPSBwcmVkaWN0KGN2Zml0LCBuZXd4ID0geF92YWxpZGF0ZSwgdHlwZSA9ICJyZXNwb25zZSIsIHMgPSBjdmZpdCRsYW1iZGEubWluKQogIENpbmRleF9hbGwkSGFycmVsbFtpXSA9IG1lYW4oYXBwbHkocHJlZCwgMiwgQ2luZGV4LCB5ID0geV92YWxpZGF0ZSkpCiAgQ2luZGV4X2FsbCRVbm9baV0gPSBVbm9DKHlfdHJhaW4sIHlfdmFsaWRhdGUsIHByZWQpCn0KZGF0X3RtcCA9IGRhdGEuZnJhbWUoeCA9IHJlcChjKCJIYXJyZWxsIiwgIlVubyIpLCBlYWNoID0gayksIHkgPSB1bmxpc3QoQ2luZGV4X2FsbCkpCgpzZXQuc2VlZCgxMjMpCmdncGxvdChkYXRfdG1wLCBhZXMoeCwgeSwgY29sID0geCkpICsgZ2VvbV9ib3hwbG90KCkgKyBnZW9tX2ppdHRlcihzaXplID0gMC41LCBhbHBoYSA9IDAuNSkgKwogICB5bGltKDAsIDEpICsgeGxhYigiIikgKyB5bGFiKCJDLWluZGV4IikgKyB0aGVtZShsZWdlbmQucG9zaXRpb249Im5vbmUiKQpgYGAKIVtfQy1pbmRleCAoSGFycmVsbCdzIGFuZCBVbm8ncykgYmFzZWQgb24gcmFuZG9tbHkgc3BsaXQgdmFsaWRhdGlvbiBkYXRhIDEwMCB0aW1lcy5fXShmaWcvVENHQV9zdXJ2X2NpbmRleF9sYXNzby5wbmcpe3dpZHRoPTQwJX0KClRoZSBgUmAgcGFja2FnZSBbKipjMDYwKipdKGh0dHBzOi8vQ1JBTi5SLXByb2plY3Qub3JnL3BhY2thZ2U9YzA2MCkgW0BTaWxsMjAxNF0gaW5jbHVkZXMgd3JhcHBlciBmdW5jdGlvbnMgZm9yIHRoZSBbKipnbG1uZXQqKl0oaHR0cHM6Ly9DUkFOLlItcHJvamVjdC5vcmcvcGFja2FnZT1nbG1uZXQpIGFsZ29yaXRobSBhbmQgaW1wbGVtZW50cyByZXNhbXBsaW5nLWJhc2VkIG1ldGhvZHMgKGUuZy4gY3Jvc3MtdmFsaWRhdGlvbiBhbmQgYm9vdHN0cmFwIC0gd2l0aCBhbmQgd2l0aG91dCByZXBsYWNlbWVudCkgYmFzZWQgb24gdGhlIFsqKnBlcGVycioqXShodHRwczovL0NSQU4uUi1wcm9qZWN0Lm9yZy9wYWNrYWdlPXBlcGVycikgcGFja2FnZSB0byBjYWxjdWxhdGUgdGhlIHRpbWUtZGVwZW5kZW50IEJyaWVyIHNjb3JlLgpbKipjMDYwKipdKGh0dHBzOi8vQ1JBTi5SLXByb2plY3Qub3JnL3BhY2thZ2U9YzA2MCkgZXh0ZW5kcyBbKipwZXBlcnIqKl0oaHR0cHM6Ly9DUkFOLlItcHJvamVjdC5vcmcvcGFja2FnZT1wZXBlcnIpIHBhY2thZ2UgdG8gYWxsb3cgbWFuZGF0b3J5IGZlYXR1cmVzIHdpdGhvdXQgcGVuYWxpemF0aW9uLgpAQmluZGVyMjAwOCByZWNvbW1lbmRzIHRvIGRyYXcgYm9vdHN0cmFwIHNhbXBsZXMgd2l0aG91dCByZXBsYWNlbWVudCAoaS5lLiBzdWJzYW1wbGluZyksIGJlY2F1c2UgYm9vdHN0cmFwIHNhbXBsZXMgd2l0aCByZXBsYWNlbWVudCBvZnRlbiByZXN1bHQgaW4gdG9vIGNvbXBsZXggbW9kZWxzIGluIGhpZ2gtZGltZW5zaW9uYWwgc2V0dGluZ3MuClRvIHVzZSByZXNhbXBsaW5nIGJ5IENWIHByb3Blcmx5IGZvciBzdXJ2aXZhbCBkYXRhLCBzZWUgQFNpbW9uMjAxMS4KTm90ZSB0aGF0IHJlc2FtcGxpbmctYmFzZWQgbWV0aG9kcyBoZXJlIGFyZSBzaW1pbGFyIHRvIHNwbGl0dGluZyAkODBcJS8yMFwlJCB0aGUgZGF0YSBtYW55IHRpbWVzIHdoaWNoIGFsbG93cyB1cyB0byBxdWFudGlmeSB0aGUgdW5jZXJ0YWludHkgb2YgdGhlIHRpbWUtZGVwZW5kZW50IEJyaWVyIHNjb3JlLgoKYGBge3J9CiMjIHRpbWUtZGVwZW5kZW50IEJyaWVyIHNjb3JlIGJ5IHN1YnNhbXBsaW5nIGZyb20gdGhlIHdob2xlIGRhdGEKc2V0LnNlZWQoMTIzKQpwZXBlcnJfb2JqZWN0ID0gcGVwZXJyOjpwZXBlcnIocmVzcG9uc2UgPSB5X3N1cnYsIHggPSB4LCBmaXQuZnVuID0gZml0LmdsbW5ldCwgCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBhcmdzLmZpdCA9IGxpc3QoZmFtaWx5ID0gImNveCIsIHBlbmFsdHkuZmFjdG9yID0gcGYpLCAKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGNvbXBsZXhpdHkgPSBjb21wbGV4aXR5LmdsbW5ldCwgIAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgYXJncy5jb21wbGV4aXR5ID0gbGlzdChmYW1pbHkgPSAiY294IiwgbmZvbGRzID0gNSwgcGVuYWx0eS5mYWN0b3IgPSBwZiksCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBpbmRpY2VzID0gcmVzYW1wbGUuaW5kaWNlcyhuID0gbiwgbWV0aG9kPSJzdWI2MzIiLCBzYW1wbGUubiA9IDEwMCkpCmMwNjA6OlBsb3QucGVwZXJyLmN1cnZlcyhwZXBlcnJfb2JqZWN0KQpgYGAKIVtfUmVzYW1wbGluZy1iYXNlZCBwcmVkaWN0aW9uIGVycm9yIGN1cnZlcyAodGltZS1kZXBlbmRlbnQgQnJpZXIgc2NvcmUpIGEgdGhlIExhc3NvIENveCBtb2RlbCBhcHBsaWVkIHRvIHRoZSBCUkNBIGRhdGEgc2V0IGZyb20gVENHQS4gVGhlIGdyYXkgYXJlYSBpbmRpY2F0ZXMgdGhlIHBvaW50d2lzZSAyLjUlIGFuZCA5Ny41JSBxdWFudGlsZXMgb2YgdGhlIDEwMCBvdXQtb2YtYmFnIGJvb3RzdHJhcCBzYW1wbGVzLiBUaGUgb3RoZXIgbGluZXMgc2hvdyB0aGUgcHJlZGljdGlvbiBlcnJvciBjdXJ2ZXMgb2YgdGhlIG51bGwgbW9kZWwgKGVzdGltYXRlZCBieSB0aGUgS2FwbGFuLU1laWVyIGVzdGltYXRvciB3aXRob3V0IGNvdmFyaWF0ZSBpbmZvcm1hdGlvbiksIHRoZSBmdWxsIGFwcGFyZW50IGVycm9yIGVzdGltYXRlcyAoaS5lLiwgdGhlIGVycm9ycyBhcyBlc3RpbWF0ZWQgd2hlbiBhcHBseWluZyB0aGUgbW9kZWwgdG8gdGhlIGVudGlyZSB0cmFpbmluZyBkYXRhIHNldCksIGFuZCB0aGUgLjYzMisgYm9vdHN0cmFwIGVycm9yIGVzdGltYXRlcy5fXShmaWcvVENHQV9zdXJ2X2JyaWVyX2xhc3NvLnBuZyl7d2lkdGg9NjAlfQoKIyMjIEZlYXR1cmUgc3RhYmlsaXR5IGFuYWx5c2lzIHstfQoKVG8gaWRlbnRpZnkgc3RhYmxlIG9taWNzIGZlYXR1cmVzLCBhIHN0cmFpZ2h0Zm9yd2FyZCB3YXkgaXMgdG8gZmluZCB0aGUgb3ZlcmxhcHBlZCBvbWljcyBmZWF0dXJlcyB3aXRoIG5vbnplcm8gY29lZmZpY2llbnRzIGFtb25nIGRpZmZlcmVudCBkYXRhIHN1YnNldHMgKGUuZy4gQ1YgZm9sZHMgb3IgcmVzYW1wbGVzKS4KVGhlIGZvbGxvd2luZyBjb2RlIHN1bW1hcml6ZXMgdGhlIExhc3NvIENveCBzZWxlY3RlZCBvbWljcyBmZWF0dXJlcyB3aGljaCB3ZXJlIGlkZW50aWZpZWQgYXQgbGVhc3QgJDIkIG9yICQ1JCBvdXQgb2YgJDEwJCByZXNhbXBsZXMuClNpbWlsYXJseSwgdGhpcyBhcHByb2FjaCBjYW4gYmUgYXBwbGllZCB0byBvdGhlciBMYXNzby10eXBlIG9yIEJheWVzaWFuIENveCBtb2RlbHMgdGhhdCBwZXJmb3JtIGZlYXR1cmUgc2VsZWN0aW9uIGZvciBpZGVudGlmeWluZyBzdGFibGUgc2VsZWN0ZWQgZmVhdHVyZXMuCgpgYGB7cn0KIyBzcGVjaWZ5IHRoZSBudW1iZXIgb2YgcmVzYW1wbGVzIGsKayA9IDEwCmJldGFfYWxsID0gbWF0cml4KG5yb3cgPSBuY29sKHgpLCBuY29sID0gaykKc2V0LnNlZWQoMTIzKQpmb3IgKGogaW4gMTprKSB7CiAgcmVzYW1wbGVfaWQgPSBzYW1wbGUoMTpucm93KHkpLCBucm93KHkpLCByZXBsYWNlID0gVFJVRSkKICByZXNhbXBsZV94ID0geFtyZXNhbXBsZV9pZCwgXQogIHJlc2FtcGxlX3kgPSB5W3Jlc2FtcGxlX2lkLCBdCiAgY3ZmaXQgPSBjdi5nbG1uZXQocmVzYW1wbGVfeCwgcmVzYW1wbGVfeSwgZmFtaWx5ID0gImNveCIsIG5mb2xkcyA9IDUsIHBlbmFsdHkuZmFjdG9yID0gcGYpCiAgYmV0YV9hbGxbLCBqXSA9IGFzLnZlY3Rvcihjb2VmKGN2Zml0LCBzID0gY3ZmaXQkbGFtYmRhLm1pbikpCn0KCihzdGFibGVfZmVhdHVyZXMgPSBjb2xuYW1lcyh4KVtyb3dTdW1zKGJldGFfYWxsICE9IDApID49IDJdKQpgYGAKYGBgCiBbMV0gImFnZSIgICAgICAgImV0aG5pY2l0eSIgIlVCRTJUIiAgICAgIkNEQzYiICAgICAgIkNDTkIxIiAgICAgIlRZTVMiICAgICAgIkNFUDU1IiAgICAgIk1FTEsiICAgICAiTkRDODAiICAgICAiVUJFMkMiICAgICAiUFRURzEiICAgICAiRVhPMSIgICAgICAiT1JDNkwiICAgICAiQU5MTiIgICAgICAiQ0NORTEiICAgICAiS0lGMkMiICAgICJBQ1RSM0IiICAgICJNWUMiICAgICAgICJFR0ZSIiAgICAgICJLUlQ1IiAgICAgICJQSEdESCIgICAgICJDREgzIiAgICAgICJNSUEiICAgICAgICJGT1hDMSIgICAgIktSVDE0IiAgICAgIkVTUjEiICAgICAgIlNMQzM5QTYiICAgIkJBRzEiICAgICAgIk1BUFQiICAgICAgIkNYWEM1IiAgICAgIk1MUEgiICAgICAgIkJDTDIiICAgICAiTURNMiIgICAgICAiRk9YQTEiICAgICAiR1BSMTYwIiAgICAiRkdGUjQiICAgICAiVE1FTTQ1QiIgICAiRVJCQjIiIApgYGAKYGBge3J9CihzdGFibGVfZmVhdHVyZXMgPSBjb2xuYW1lcyh4KVtyb3dTdW1zKGJldGFfYWxsICE9IDApID49IDVdKQpgYGAKYGBgCiBbMV0gImFnZSIgICAgICAgImV0aG5pY2l0eSIgIlVCRTJUIiAgICAgIkNFUDU1IiAgICAgIlVCRTJDIiAgICAgIk9SQzZMIiAgICAgIkFOTE4iICAgICAgIkVTUjEiICAgICAgIkJBRzEiICAgICAiTUxQSCIgICAgICAiTURNMiIgICAgICAiR1BSMTYwIiAgICAiRkdGUjQiICAgICAiRVJCQjIiCmBgYAoKQWx0ZXJuYXRpdmVseSBmb3IgYSBCYXllc2lhbiBDb3ggbW9kZWwsIGl0cyBtZWRpYW4gcHJvYmFiaWxpdHkgbW9kZWwgKE1QTSkgY2FuIGJlIG9idGFpbmVkIGJhc2VkIG9uIHRoZSBjb2VmZmljaWVudCBlc3RpbWF0ZXMgb3ZlciBNQ01DIGl0ZXJhdGlvbnMuClRoZSBmb2xsb3dpbmcgY29kZSBzaG93cyBob3cgdG8gb2J0YWluIHRoZSBNUE0ncyBjb2VmZmljaWVudHMgb2YgdGhlIHBlbmFsaXplZCBzZW1pcGFyYW1ldHJpYyBCYXllc2lhbiBDb3ggbW9kZWwgd2l0aCBFbGFzdGljIE5ldCBwcmlvciBydW4gcHJldmlvdXNseS4KCmBgYHtyfQpnYW1tYXMgPSBjb2xNZWFucyhtYXRyaXgoYXMubnVtZXJpYyhFTl9iZXRhX3AgIT0gMCksIG5jb2wgPSBuY29sKEVOX2JldGFfcCkpKQpiZXRhX01QTSA9IChnYW1tYXMgPj0gMC41KSAqIGNvbE1lYW5zKEVOX2JldGFfcCkgLyBnYW1tYXMKYmV0YV9NUE1baXMubmEoYmV0YV9NUE0pXSA9IDAKYmV0YV9NUE0KYGBgCmBgYAogWzFdICAwLjAwMDAwMDAwMDAgLTAuMDE3MjAxNTI4MCAgMC4wMzA0MzE2NjE2IC0wLjAxMTQ2MjMzMDggIDAuMDgzNzgyNDEzMiAtMC4wNTQ3OTgzMzI3CiBbN10gIDAuMTQwNzQzOTEyNiAtMC4wNTYyNDM4MzUwICAwLjAyMzM0MTMyNTggIDAuMDgyMjU0ODk2NiAtMC4wMjE2OTU2MDA5IC0wLjAwNDY1MzE5OTEKWzEzXSAgMC4wMDAwMDAwMDAwIC0wLjAxMDI0MzI3MDcgLTAuMDQ2Mjc2NDI4MSAtMC4wMjYxMjMzNTAzICAwLjEyMDQ0NTI2OTIgIDAuMDQ5ODM4MDYzMgpbMTldICAwLjAwMDAwMDAwMDAgIDAuMDAwMDAwMDAwMCAgMC4wNDExMzU0MjcxICAwLjAwMDgyNTA5NTkgLTAuMDc0NzEyMTMyOCAgMC4zNzA5OTk2MDM1ClsyNV0gLTAuMDcxNDEyMzc4NSAgMC4wNTMxODg0NDkxIC0wLjAyNjMzNzk1NTIgLTAuMDI3ODE1NzUxMSAgMC4wODY4MjEzOTE3IC0wLjA0MTc1ODQzMzQKWzMxXSAtMC4wMTU0NjA5OTgwIC0xLjc1OTc3NjM5OTIgIDAuMDI0ODAxODE3MiAgMC4xNTgzNDQ4Nzg0ICAwLjAwMDAwMDAwMDAgLTAuMDI3MDI3NTA4MApbMzddICAwLjAzMTYyNzk4NTEgIDAuMTg5NjA2MTA3NSAgMC4wMzU5MDYzNjg3IC0wLjEzNzMyMjQ2MjEgLTAuMTY0ODgzMzE3NCAgMC4wMzQ2NDk0NjExCls0M10gIDAuMTE2ODMzNDMxNSAgMC4wMjI0NzkxODU3ICAwLjEzMzYzNDQ4ODEgLTAuMDA0NzQzNTEwOCAgMC4wMTg3NDg0MjI4ICAwLjExNzg5OTYzNjQKWzQ5XSAtMC4xNjk2NTMxMTI2ICAwLjA1NzM3MTM2OTQgLTAuMDMwODg5Nzc4NyAtMC4yMTMwODE5Mzg3CmBgYAoKIyMjIEdyYXBoaWNhbCBjb21wdXRhdGlvbgoKQWZ0ZXIgaWRlbnRpZnlpbmcgc3RhYmxlIG9taWNzIGZlYXR1cmVzIHByZWRpY3RpdmUgb2Ygc3Vydml2YWwgb3V0Y29tZXMsIHdlIGNhbiBkcmF3IGEgbm9tb2dyYW0gdG8gYWxsb3dzIHRoZSBncmFwaGljYWwgY2FsY3VsYXRpb24gb2Ygc3Vydml2YWwgcHJvYmFiaWxpdGllcyBmb3IgcHJhY3RpdGlvbmVycy4KCldlIGRlbW9uc3RyYXRlIGEgbm9tb2dyYW0gdXNpbmcgdGhlIHN0YWJsZSBzZWxlY3RlZCBmZWF0dXJlcyBmcm9tIFRDR0EgYnJlYXN0IGNhbmNlciBkYXRhIHByZXByb2Nlc3NlZCBwcmV2aW91c2x5LgpUaGUgYFJgIHBhY2thZ2UgKipyZWdwbG90KiogZHJhd3MgYW4gZW5oYW5jZWQgcmVncmVzc2lvbiBub21vZ3JhbSBiYXNlZCBvbiB0aGUgKipybXMqKiBwYWNrYWdlLgoKYGBge3J9CiMgcmVtb3ZlIHBhdGllbnRzIHdpdGhvdXQgcmVwb3J0aW5nIGV0aG5pY2l0eQp5eSA9IHlbeFssIDJdICE9IDMsIF0KeHggPSB4W3hbLCAyXSAhPSAzLCBdCiMgc3BlY2lmeSB0aGUgbnVtYmVyIG9mIHJlc2FtcGxlcyBrCmsgPSAxMApiZXRhX2FsbCA9IG1hdHJpeChucm93ID0gbmNvbCh4eCksIG5jb2wgPSBrKQpzZXQuc2VlZCgxMjMpCmZvciAoaiBpbiAxOmspIHsKICByZXNhbXBsZV9pZCA9IHNhbXBsZSgxOm5yb3coeXkpLCBucm93KHl5KSwgcmVwbGFjZSA9IFRSVUUpCiAgcmVzYW1wbGVfeCA9IHh4W3Jlc2FtcGxlX2lkLCBdCiAgcmVzYW1wbGVfeSA9IHl5W3Jlc2FtcGxlX2lkLCBdCiAgY3ZmaXQgPSBjdi5nbG1uZXQocmVzYW1wbGVfeCwgcmVzYW1wbGVfeSwgZmFtaWx5ID0gImNveCIsIG5mb2xkcyA9IDUsIHBlbmFsdHkuZmFjdG9yID0gcGYpCiAgYmV0YV9hbGxbLCBqXSA9IGFzLnZlY3Rvcihjb2VmKGN2Zml0LCBzID0gY3ZmaXQkbGFtYmRhLm1pbikpCn0KCiMgaWRlbnRpZnkgZmVhdHVyZXMgYXQgbGVhc3QgODAlIGZyZXF1ZW50bHkgc2VsZWN0ZWQKeF9zdGFibGUgPSBkYXRhLmZyYW1lKHh4Wywgcm93U3VtcyhiZXRhX2FsbCAhPSAwKSA+PSBrICogMC44XSkKeF9zdGFibGUkZXRobmljaXR5ID0gZmFjdG9yKHhfc3RhYmxlJGV0aG5pY2l0eSkgCmxldmVscyh4X3N0YWJsZSRldGhuaWNpdHkpID0gYygiSGlzcGFuaWMvbGF0aW5vIiwgIk5vdCBoaXNwYW5pYy9sYXRpbm8iKQoKZGF0YV90bXAgPSBkYXRhLmZyYW1lKHRpbWVzID0geXlbLCAidGltZSJdLCBzdGF0dXMgPSB5eVssICJzdGF0dXMiXSwgeF9zdGFibGUpCmYgPSBjcGgoZm9ybXVsYSA9IFN1cnYodGltZXMsIHN0YXR1cykgfiBhZ2UgKyBldGhuaWNpdHkgKyBVQkUyVCArIE9SQzZMICsgRVNSMSwgIAogICAgICAgICAgICAgZGF0YSA9IGRhdGFfdG1wLCB4ID0gVFJVRSwgeSA9IFRSVUUsIHN1cnYgPSBUUlVFKQpkZGlzdCA9IGRhdGFkaXN0KGRhdGFfdG1wKQpvbGRvcHRpb24gPSBvcHRpb25zKGRhdGFkaXN0ID0gJ2RkaXN0JykKc3VydiA9IFN1cnZpdmFsKGYpCm5vbSA9IG5vbW9ncmFtKGYsIGZ1biA9IGxpc3QoZnVuY3Rpb24oeCkgc3VydigxLCB4KSwgZnVuY3Rpb24oeCkgc3VydigzLCB4KSwgZnVuY3Rpb24oeCkgc3Vydig1LCB4KSksCiAgICAgICAgICAgICAgICAgICAgZnVubGFiZWwgPSBjKCIxLVllYXIgU3Vydml2YWwgUHJvYmFiaWxpdHkiLCAKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIjMtWWVhciBTdXJ2aXZhbCBQcm9iYWJpbGl0eSIsIAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAiNS1ZZWFyIFN1cnZpdmFsIFByb2JhYmlsaXR5IiksCiAgICAgICAgICAgICAgICAgICAgbHAgPSBGQUxTRSkKcmVncGxvdDo6cmVncGxvdChmLCBvYnNlcnZhdGlvbiA9IGRhdGFfdG1wWzEsXSwgZmFpbHRpbWUgPSBjKDEsIDMsIDUpLCB0aXRsZSA9ICIiLAogICAgICAgICAgICAgICAgIHByZmFpbCA9IEZBTFNFLCBwb2ludHMgPSBUUlVFLCBzaG93UCA9IEZBTFNFLCBzdWJ0aWNrcyA9IFRSVUUpIApgYGAKIVtfTm9tb2dyYW0gZGV2ZWxvcGVkIHRvIGVzdGltYXRlIHRoZSBvdmVyYWxsIHN1cnZpdmFsIHByb2JhYmlsaXR5IGZvciBUQ0dBJ3MgQlJBQyBwYXRpZW50cyBiYXNlZCBvbiBkZW1vZ3JhcGhpYyBhbmQgTGFzc28gQ294IHNlbGVjdGVkIG1STkEgZmVhdHVyZXMuIFRoZSByZWQgY29sb3VyZWQgc3ltYm9scyByZXByZXNlbnQgb25lIHBhdGllbnTigJlzIGluZm9ybWF0aW9uIGFuZCBwcmVkaWN0ZWQgcHJvYmFiaWxpdGllcyBvZiAxLXllYXIsIDMteWVhciBhbmQgNS15ZWFyIHN1cnZpdmFsLl9dKGZpZy9UQ0dBX3N1cnZfbm9tb2dyYW0ucG5nKXt3aWR0aD04MCV9CgpBIGNhbGlicmF0aW9uIHBsb3QgaXMgYSBzdHJhaWdodGZvcndhcmQgdmlzdWFsaXphdGlvbiB0byBzaG93IHRoZSBwcmVkaWN0aW9uIGFiaWxpdHkgb2YgdGhlIG5vbW9ncmFtLCBpLmUuLCB0aGUgYWdyZWVtZW50IGJldHdlZW4gcHJlZGljdGVkIHN1cnZpdmFsIHByb2JhYmlsaXRpZXMgZnJvbSB0aGUgZmluYWwgbW9kZWwgYW5kIHRoZSBLTSBlc3RpbWF0ZWQgc3Vydml2YWwgcHJvYmFiaWxpdGllcyBpbiBkaWZmZXJlbnQgcGVyY2VudGlsZXMgb2YgdGhlIHByZWRpY3RlZCB2YWx1ZXMgYXQgYSB0aW1lIHBvaW50IG9mIGludGVyZXN0LiAKV2UgZGVtb25zdHJhdGUgYmVsb3cgY2FsaWJyYXRpb24gcGxvdHMgYmFzZWQgb24gdHJhaW5pbmcgYW5kIHZhbGlkYXRpb24gZGF0YSBzZXRzLCByZXNwZWN0aXZlbHkuCgpgYGB7cn0KIyBDYWxpYnJhdGlvbiBhdCA1LXllYXIgdGltZS1wb2ludAoKIyBwcmVwYXJlIHN1aXRhYmxlIGRhdGEgZm9ybWF0IGZvciBjYWxpYnJhdGlvbiBwbG90CnNldC5zZWVkKDEyMykKdHJhaW5faWQgPC0gc2FtcGxlKDE6bnJvdyh5eSksIG5yb3coeXkpICogMC44LCByZXBsYWNlID0gRkFMU0UpCmRhdGFfdHJhaW4gPSBkYXRhX3RtcFt0cmFpbl9pZCwgXQpkYXRhX3ZhbGlkYXRlID0gZGF0YV90bXBbLXRyYWluX2lkLCBdCgpkZGlzdCA9IGRhdGFkaXN0KGRhdGFfdHJhaW4pCm9wdGlvbnMoZGF0YWRpc3Q9J2RkaXN0JykKZl90cmFpbiA9IGNwaChmb3JtdWxhID0gU3Vydih0aW1lcywgc3RhdHVzKSB+IGFnZSArIGV0aG5pY2l0eSArIFVCRTJUICsgT1JDNkwgKyBFU1IxLAogICAgICAgICAgICAgIGRhdGEgPSBkYXRhX3RyYWluLCB4ID0gVFJVRSwgeSA9IFRSVUUsIHN1cnYgPSBUUlVFLCB0aW1lLmluYyA9IDUpCmZfdmFsaWRhdGUgPSBjcGgoZm9ybXVsYSA9IFN1cnYodGltZXMsIHN0YXR1cykgfiBhZ2UgKyBldGhuaWNpdHkgKyBVQkUyVCArIE9SQzZMICsgRVNSMSwKICAgICAgICAgICAgICBkYXRhID0gZGF0YV92YWxpZGF0ZSwgeCA9IFRSVUUsIHkgPSBUUlVFLCBzdXJ2ID0gVFJVRSwgdGltZS5pbmMgPSA1KQpjYWxfdHJhaW4gPSBjYWxpYnJhdGUoZl90cmFpbiwgdSA9IDUsIGNtZXRob2QgPSAiS00iLCBtID0gbnJvdyhkYXRhX3RyYWluKSAvIDUsIEIgPSAyMDApCmNhbF92YWxpZGF0ZSA9IGNhbGlicmF0ZShmX3ZhbGlkYXRlLCB1ID0gNSwgY21ldGhvZCA9ICJLTSIsIG0gPSBucm93KGRhdGFfdmFsaWRhdGUpIC8gNSwgQiA9IDIwMCkKCnBkZigiVENHQV9zdXJ2X2NhbGlicmF0aW9uLnBkZiIsIHdpZHRoPTcsIGhlaWdodD00KQpsYXlvdXQobWF0cml4KDE6MiwgbnJvdyA9IDEpKQpwbG90KGNhbF90cmFpbiwgbHdkID0gMiwgbHR5ID0gMSwgZXJyYmFyLmNvbCA9ICJzZWFncmVlbjMiLAogICAgIHhsYWIgPSAnUHJlZGljdGVkIHN1cnZpdmFsIHByb2JhYmlsaXR5JywgeWxhYiA9ICdBY3R1YWwgc3Vydml2YWwgcHJvYmFiaWxpdHknLAogICAgIHhsaW0gPSBjKDAsMSksIHlsaW0gPSBjKDAsMSksIGNvbCA9ICJzZWFncmVlbjMiLCBzdWJ0aXRsZXMgPSBGQUxTRSkKdGl0bGUobWFpbiA9ICJDYWxpYnJhdGlvbiBvbiB0cmFpbmluZyBkYXRhIikKCnBsb3QoY2FsX3ZhbGlkYXRlLCBsd2QgPSAyLCBsdHkgPSAxLCBlcnJiYXIuY29sID0gInNlYWdyZWVuMyIsCiAgICAgeGxhYiA9ICdQcmVkaWN0ZWQgc3Vydml2YWwgcHJvYmFiaWxpdHknLCB5bGFiID0gJ0FjdHVhbCBzdXJ2aXZhbCBwcm9iYWJpbGl0eScsCiAgICAgeGxpbSA9IGMoMCwxKSwgeWxpbSA9IGMoMCwxKSwgY29sID0gInNlYWdyZWVuMyIsIHN1YnRpdGxlcyA9IEZBTFNFKQp0aXRsZShtYWluID0gIkNhbGlicmF0aW9uIG9uIHZhbGlkYXRpb24gZGF0YSIpCmRldi5vZmYoKQpgYGAKIVtfTm9tb2dyYW0gbW9kZWwgY2FsaWJyYXRpb24gY3VydmVzIGZvciBUQ0dBJ3MgQlJBQyBwYXRpZW50cyBhdCA1LXllYXIgZXZhbHVhdGlvbiB0aW1lLXBvaW50Ll9dKGZpZy9UQ0dBX3N1cnZfY2FsaWJyYXRpb24ucG5nKXt3aWR0aD03MCV9CgoKIyMgTW9kZWwgZXZhbHVhdGlvbiAobWxyMykgey0jbWxyM30KCjo6OnsuZ3JlZW4tYm94fQpVc2luZyB0aGUgWyoqbWxyMyoqXShodHRwczovL21scjMubWxyLW9yZy5jb20pIG1hY2hpbmUgbGVhcm5pbmcgZnJhbWV3b3JrIGFuZCB0aGUgWyoqbWxyM3Byb2JhKipdKGh0dHBzOi8vbWxyM3Byb2JhLm1sci1vcmcuY29tKSBgUmAgbGlicmFyeSwgd2Ugd2lsbCBkZW1vbnN0cmF0ZSBob3cgdG86CgotIENyZWF0ZSBhIHN1cnZpdmFsIHRhc2sgZnJvbSBhIGRhdGFzZXQgYW5kIHNwbGl0IGl0IHRvIHRyYWluaW5nIGFuZCB0ZXN0ICh2YWxpZGF0aW9uKSBzZXRzCi0gRGVmaW5lIGEgTGFzc28gQ294IG1vZGVsIHRoYXQgY2FuIG91dHB1dCBib3RoIGxpbmVhciBwcmVkaWN0b3JzIGFuZCBzdXJ2aXZhbCBkaXN0cmlidXRpb24gcHJlZGljdGlvbnMgYW5kIHRyYWluL3R1bmUgaXQgb24gdGhlIHRyYWluaW5nIHNldAotIE1ha2UgcHJlZGljdGlvbnMgdXNpbmcgdGhlIHRyYWluZWQgTGFzc28gQ294IG1vZGVsIG9uIHRoZSBzZXBhcmF0ZSB0ZXN0IHNldAotIE1lYXN1cmUgdGhlIHBlcmZvcm1hbmNlIG9mIG91ciBtb2RlbCAoZGlzY3JpbWluYXRpb24gYW5kIGNhbGlicmF0aW9uKSB1c2luZyBzZXZlcmFsIGV2YWx1YXRpb24gbWV0cmljcwotIFVzaW5nIHJlc2FtcGxpbmcgdGVjaG5pcXVlcywgd2Ugd2lsbCBhc3Nlc3Mgb3VyIG1vZGVsJ3MgY2FwYWNpdHkgZm9yIGdlbmVyYWxpemF0aW9uIChwcmVkaWN0aW9uIG9uIHVuc2VlbiBkYXRhKSBhbmQgdGhlIHN0YWJpbGl0eSBvZiB0aGUgbW9kZWwncyBzZWxlY3RlZCBmZWF0dXJlcwo6OjoKCkZvciB0aGUgcmVzdCBvZiB0aGUgYW5hbHlzaXMsIHdlIHdpbGwgYm9ycm93IHRoZSB0ZXJtaW5vbG9neSBmcm9tIHRoZSBbKiptbHIzKipdKGh0dHBzOi8vbWxyMy5tbHItb3JnLmNvbSkgZWNvc3lzdGVtIG9mIG1hY2hpbmUgbGVhcm5pbmcgcGFja2FnZXMgKGUuZy4gKnRhc2sqIGlzIGEgZGF0YXNldCwgKmxlYXJuZXIqIGlzIGEgbW9kZWwsIGV0Yy4pLgpTZWUgW21scjMgYm9va10oaHR0cHM6Ly9tbHIzYm9vay5tbHItb3JnLmNvbS8pIGZvciBtb3JlIGRldGFpbHMuCgpGaXJzdCwgd2UgbG9hZCB0aGUgbmVjZXNzYXJ5IFsqKm1scjMqKl0oaHR0cHM6Ly9tbHIzLm1sci1vcmcuY29tKSBsaWJyYXJpZXMgW0BMYW5nMjAxOTsgQFNvbmFiZW5kMjAyMV0gYW5kIHNvbWUgb3RoZXIgdXNlZnVsIG9uZXM6CmBgYHtyLCBtZXNzYWdlPUZBTFNFfQpsaWJyYXJ5KCJtbHIzdmVyc2UiKSAjIG1scjMsIG1scjNwaXBlcGxpbmVzLCBtbHIzbGVhcm5lcnMsIG1scjN0dW5pbmcsIHBhcmFkb3gsIGV0Yy4KbGlicmFyeSgibWxyM3Byb2JhIikgIyBwcm9iYWJpbGlzdGljIGxlYXJuaW5nIGFuZCBzdXJ2aXZhbCBhbmFseXNpcwpsaWJyYXJ5KCJtbHIzZXh0cmFsZWFybmVycyIpICMgZm9yIGxybignc3Vydi5nbG1uZXQnKQpgYGAKCiMjIyBXb3JrZmxvdyB7LX0KCldlIGNvbnN0cnVjdCBhbiBbKiptbHIzKipdKGh0dHBzOi8vbWxyMy5tbHItb3JnLmNvbSkgKnN1cnZpdmFsIHRhc2sqIChUQ0dBIEJSQ0EgZGF0YXNldCBlc3NlbnRpYWxseSwgd2l0aCBub3JtYWxpemVkIFBBTTUwIGdlbmUgZXhwcmVzc2lvbiBmZWF0dXJlcyBhbmQgdHdvIGNsaW5pY2FsL2RlbW9ncmFwaGljIHZhcmlhYmxlcykgYW5kIHNwbGl0IGl0IGludG8gdHJhaW5pbmcgYW5kIHRlc3Qgc2V0cyAoJDgwXCUvMjBcJSQpOgpgYGB7cn0KIyBGcm9tICdQZW5hbGl6ZWQgQ294IG1vZGVscycgc2VjdGlvbjoKIyB4ID0+IGdlbmUgZXhwcmVzc2lvbiBtYXRyaXggKDUwIFBBTTUwIGdlbmVzKSArIDIgY2xpbmljYWwgdmFyaWFibGVzCiMgeSA9PiAodGltZSwgc3RhdHVzKSB0YXJnZXQgbWF0cml4CgpkYXRhID0gY2JpbmQuZGF0YS5mcmFtZSh4LCB5KQojIGRhdGEgPSByZWFkUkRTKGZpbGUgPSAnZGF0YS5yZHMnKQp0YXNrID0gbWxyM3Byb2JhOjphc190YXNrX3N1cnYoeCA9IGRhdGEsIAogIHRpbWUgPSAndGltZScsIGV2ZW50ID0gJ3N0YXR1cycsIGlkID0gJ0JSQ0EtVENHQScpCnRhc2sgIyBzZWUgdXNlZnVsIGluZm8gYWJvdXQgdGhlIGRhdGFzZXQgKCNmZWF0dXJlcywgI3NhbXBsZXMsIHRhcmdldCB2YXJpYWJsZXMpCgojIHNwbGl0IHRvIHRyYWluIGFuZCB0ZXN0IHNldHMKc2V0LnNlZWQoNDIpCnNwbGl0ID0gbWxyMzo6cGFydGl0aW9uKHRhc2ssIHJhdGlvID0gMC44KQojIHNwbGl0JHRyYWluICMgdHJhaW4gaW5kaWNlcwojIHNwbGl0JHRlc3QgIyB0ZXN0IGluZGljZXMKYGBgCmBgYAo8VGFza1N1cnY6QlJDQS1UQ0dBPiAoMTA0NyB4IDU0KQoqIFRhcmdldDogdGltZSwgc3RhdHVzCiogUHJvcGVydGllczogLQoqIEZlYXR1cmVzICg1Mik6CiAgLSBkYmwgKDUyKTogQUNUUjNCLCBBTkxOLCBCQUcxLCBCQ0wyLCBCSVJDNSwgQkxWUkEsIENDTkIxLCBDQ05FMSwKICAgIENEQzIwLCBDREM2LCBDREgzLCBDRU5QRiwgQ0VQNTUsIENYWEM1LCBFR0ZSLCBFUkJCMiwgRVNSMSwgRVhPMSwKICAgIEZHRlI0LCBGT1hBMSwgRk9YQzEsIEdQUjE2MCwgR1JCNywgS0lGMkMsIEtSVDE0LCBLUlQxNywgS1JUNSwgTUFQVCwKICAgIE1ETTIsIE1FTEssIE1JQSwgTUtJNjcsIE1MUEgsIE1NUDExLCBNWUJMMiwgTVlDLCBOQVQxLCBOREM4MCwgTlVGMiwKICAgIE9SQzZMLCBQR1IsIFBIR0RILCBQVFRHMSwgUlJNMiwgU0ZSUDEsIFNMQzM5QTYsIFRNRU00NUIsIFRZTVMsCiAgICBVQkUyQywgVUJFMlQsIGFnZSwgZXRobmljaXR5CmBgYAoKV2UgY3JlYXRlIGEgTGFzc28gQ294IFsqKm1scjMqKl0oaHR0cHM6Ly9tbHIzLm1sci1vcmcuY29tKSAqZ3JhcGggbGVhcm5lciogKGEgd3JhcHBlciBhcm91bmQgdGhlIGBnbG1uZXQ6OmN2LmdsbW5ldCgpYCBmdW5jdGlvbiB3aXRoIHRoZSBjYXBhY2l0eSB0byBwcm92aWRlIHN1cnZpdmFsIHByZWRpY3Rpb25zKSwgd2hlcmUgd2Ugc3BlY2lmeSB0aGUgdHdvIGNsaW5pY2FsIHZhcmlhYmxlcyB0byBiZSAqbWFuZGF0b3J5KiAoaS5lLiBubyBwZW5hbGl6YXRpb24pIGFuZCB0aGUgJHMkIHZhbHVlICgkXGxhbWJkYSQgcGFyYW1ldGVyIHVzZWQgZm9yIHByZWRpY3Rpb24pIGVxdWFsIHRvIGBsYW1iZGEubWluYDoKYGBge3J9CiN0YWlsKHRhc2skZmVhdHVyZV9uYW1lcykgIyBhZ2UsIGV0aG5pY2l0eSBhcmUgdGhlIDIgbGFzdCBmZWF0dXJlcwpwZiA9IGMocmVwKDEsIGxlbmd0aCh0YXNrJGZlYXR1cmVfbmFtZXMpIC0gMiksIHJlcCgwLCAyKSkKCiMgZGVmaW5lIG1vZGVsCmNveGxhc3NvID0gbHJuKCdzdXJ2LmN2X2dsbW5ldCcsIGFscGhhID0gMSwgbmZvbGRzID0gNSwgcyA9ICdsYW1iZGEubWluJywKICBwZW5hbHR5LmZhY3RvciA9IHBmKQojIGNveGxhc3NvICMgc2VlIGRldGFpbHMgb2YgY294bGFzc28gbGVhcm5lcgojIGNveGxhc3NvJGhlbHAoKSAjIGZvciBtb3JlIGRldGFpbHMKCiMgP21scl9ncmFwaHNfZGlzdHJjb21wb3NpdG9yCmNveGxhc3NvX2dybHJuID0gbWxyM3BpcGVsaW5lczo6cHBsKCdkaXN0cmNvbXBvc2l0b3InLAogIGxlYXJuZXIgPSBjb3hsYXNzbywKICBlc3RpbWF0b3IgPSAna2FwbGFuJywgIyBLTSBlc3RpbWF0b3IgZm9yIHRoZSBiYXNlbGluZQogIGZvcm0gPSAncGgnLCAjIFByb3BvcnRpb25hbCBIYXphcmRzIGZvcm0gc2luY2Ugd2UgdXNlIGEgTGFzc28gQ294IG1vZGVsCiAgZ3JhcGhfbGVhcm5lciA9IFRSVUUKKQpjb3hsYXNzb19ncmxybiRpZCA9ICdMYXNzbyBDb3gnCiMgY294bGFzc29fZ3Jscm4kZ3JhcGhfbW9kZWwkcGxvdChodG1sID0gVFJVRSkgIyBwbG90IHRoZSBncmFwaCBsZWFybmVyCmBgYAoKOjo6ey5pbmZvLWJveCAubm90ZX0KQSBDb3ggcHJvcG9ydGlvbmFsIGhhemFyZHMgbW9kZWwgKGFuZCBMYXNzbyBDb3ggYXMgYSBjb25zZXF1ZW5jZSkgaXMgYSBzZW1pLXBhcmFtZXRyaWMgbW9kZWwsIHdoaWNoIG1lYW5zIHRoYXQgaXQgZG9lcyBub3QgcHJvZHVjZSBzdXJ2aXZhbCBkaXN0cmlidXRpb24gcHJlZGljdGlvbnMgYnkgZGVmYXVsdC4KSG93ZXZlciwgdXNpbmcgdGhlIGZ1bmN0aW9uIGBzdXJ2aXZhbDo6c3VydmZpdC5jb3hwaCgpYCB5b3UgY2FuIHRyYW5zZm9ybSB0aGUgYGN2LmdsbW5ldGAncyBvdXRwdXQgbGluZWFyIHByZWRpY3RvcnMgKGBscGApIHRvIHN1cnZpdmFsIGRpc3RyaWJ1dGlvbiBwcmVkaWN0aW9ucy4KVGhpcyB0cmFuc2Zvcm1hdGlvbiBpbnRlcm5hbGx5IHVzZXMgdGhlIEJyZXNsb3cgZXN0aW1hdG9yIGZvciB0aGUgY3VtdWxhdGl2ZSBiYXNlbGluZSBoYXphcmQgKHNlZSBgc3R5cGVgIHBhcmFtZXRlcikuCgpVc2luZyBbKiptbHIzcHJvYmEqKl0oaHR0cHM6Ly9tbHIzcHJvYmEubWxyLW9yZy5jb20pIFtAU29uYWJlbmQyMDIxXSwgd2UgY2FuIGNvbnN0cnVjdCBhIHBpcGVsaW5lIFtAbWxyM3BpcGVsaW5lczIwMjFdIHRoYXQgY29tYmluZXMgdGhlIGRpc3RyaWJ1dGlvbiBwcmVkaWN0aW9ucyBvZiBhIGJhc2VsaW5lIG1vZGVsIChlLmcuIEthcGxhbiBNZWllcikgd2l0aCB0aGUgbGluZWFyIHByZWRpY3RvcnMgb2YgYSBDb3gtdHlwZSBtb2RlbCAoZS5nLiBMYXNzbyBDb3gpLgpTZWUgZGV0YWlscyBzdWNoIGFzIHRoZSB0cmFuc2Zvcm1hdGlvbiBhc3N1bXB0aW9ucywgdGhlIGNob2ljZSBvZiB0aGUgc3Vydml2YWwgZnVuY3Rpb24gZm9ybSBhbmQgdGhlIGF2YWlsYWJsZSBiYXNlbGluZSBzdXJ2aXZhbCBkaXN0cmlidXRpb24gZXN0aW1hdG9ycyBvbiB0aGUgcmVzcGVjdGl2ZSBbZG9jdW1lbnRhdGlvbl0oaHR0cHM6Ly9tbHIzcHJvYmEubWxyLW9yZy5jb20vcmVmZXJlbmNlL21scl9waXBlb3BzX2NvbXBvc2VfZGlzdHIuaHRtbCkuCjo6OgoKVHJhaW4gdGhlIExhc3NvIENveCBtb2RlbDoKYGBge3J9CnNldC5zZWVkKDMpCmNveGxhc3NvX2dybHJuJHRyYWluKHRhc2ssIHJvd19pZHMgPSBzcGxpdCR0cmFpbikKIyB2aWV3IGBjdi5nbG1uZXRgIGZpdApjb3hsYXNzb19ncmxybiRtb2RlbCRzdXJ2LmN2X2dsbW5ldCRtb2RlbApgYGAKYGBgCkNhbGw6ICAoaWYgKGN2KSBnbG1uZXQ6OmN2LmdsbW5ldCBlbHNlIGdsbW5ldDo6Z2xtbmV0KSh4ID0gZGF0YSwgeSA9IHRhcmdldCwgICAgICBuZm9sZHMgPSA1TCwgYWxwaGEgPSAxLCBwZW5hbHR5LmZhY3RvciA9IGMoMSwgLi4uLCAwLCAwKSwgZmFtaWx5ID0gImNveCIpIAoKTWVhc3VyZTogUGFydGlhbCBMaWtlbGlob29kIERldmlhbmNlIAoKICAgICBMYW1iZGEgSW5kZXggTWVhc3VyZSAgICAgU0UgTm9uemVybwptaW4gMC4wMDk5NCAgICAxNSAgIDEyLjMwIDAuMjcxOSAgICAgIDE1CjFzZSAwLjAzNjU2ICAgICAxICAgMTIuMzUgMC4yNTYyICAgICAgIDIKYGBgCgpHZXQgdGhlIHN1cnZpdmFsIGRpc3RyaWJ1dGlvbiBwcmVkaWN0aW9ucyAoJGRpc3RyJCkgYWxvbmcgd2l0aCB0aGUgbGluZWFyIHByZWRpY3RvcnMgKCRscCQpOgpgYGB7cn0KcHJlZCA9IGNveGxhc3NvX2dybHJuJHByZWRpY3QodGFzaywgcm93X2lkcyA9IHNwbGl0JHRlc3QpCmhlYWQoYXMuZGF0YS50YWJsZShwcmVkKSkKYGBgCmBgYAogICByb3dfaWRzICAgICAgdGltZSBzdGF0dXMgICAgIGNyYW5rICAgICAgICBscCAgICAgZGlzdHIKMTogICAgICAgNSAwLjk1Mjc3MjEgIEZBTFNFIC0zLjMyOTEzMyAtMy4zMjkxMzMgPGxpc3RbMV0+CjI6ICAgICAgIDYgNC4wNDM4MDU2ICBGQUxTRSAtMy44MDA3NjYgLTMuODAwNzY2IDxsaXN0WzFdPgozOiAgICAgIDE1IDEuNzM4NTM1MiAgRkFMU0UgLTIuNzg2NjYyIC0yLjc4NjY2MiA8bGlzdFsxXT4KNDogICAgICA0NSA0LjU4MDQyNDQgIEZBTFNFIC0yLjc2MTExMCAtMi43NjExMTAgPGxpc3RbMV0+CjU6ICAgICAgNTAgNS4xMjc5OTQ1ICBGQUxTRSAtMy43MzYyMTEgLTMuNzM2MjExIDxsaXN0WzFdPgo2OiAgICAgIDU0IDYuNjg1ODMxNiAgRkFMU0UgLTMuNDk5NjkxIC0zLjQ5OTY5MSA8bGlzdFsxXT4KYGBgCgpTbyBmb3IgZXZlcnkgcGF0aWVudCBpbiB0aGUgdGVzdCBzZXQsIHRoZSBMYXNzbyBDb3ggbW9kZWwgcHJlZGljdGlvbiBpcyBhIGxpbmVhciBwcmVkaWN0b3Igb2YgdGhlIGZvcm0gJGxwID0gXGhhdHtcYmV0YX0gWF97bmV3fSQuCiRjcmFuayQgc3RhbmRzIGZvciBjb250aW51b3VzIHJhbmtpbmcgc2NvcmUgYW5kIGl0J3MgdGhlIHNhbWUgYXMgJGxwJCBmb3IgdGhlIExhc3NvIENveCBtb2RlbC4KVGhlICRkaXN0ciQgcHJlZGljdGlvbnMgYXJlIHRoZSBwZXItcGF0aWVudCBzdXJ2aXZhbCBkaXN0cmlidXRpb24gcHJlZGljdGlvbnMsIGltcGxlbWVudGVkIGJ5IHRoZSBgUmAgcGFja2FnZSBbZGlzdHI2XShodHRwczovL2dpdGh1Yi5jb20vYWxhbi10dXJpbmctaW5zdGl0dXRlL2Rpc3RyNikgd2hpY2ggdGhlIFsqKm1scjNwcm9iYSoqXShodHRwczovL21scjNwcm9iYS5tbHItb3JnLmNvbSkgaW1wb3J0cy4KU2VlIHJlc3BlY3RpdmUgW2RvY3VtZW50YXRpb25dKGh0dHBzOi8vbWxyM3Byb2JhLm1sci1vcmcuY29tL3JlZmVyZW5jZS9QcmVkaWN0aW9uU3Vydi5odG1sKSBvbiB0aGUgZGlmZmVyZW50IHByZWRpY3Rpb24gdHlwZXMgc3VwcG9ydGVkLgoKQW4gZXhhbXBsZSBvZiB1c2luZyB0aGUgYGRpc3RyYCBwcmVkaWN0aW9ucyB3b3VsZCBiZSB0byByZXF1ZXN0IGZvciB0aGUgc3Vydml2YWwgcHJvYmFiaWxpdHkgYXQgZS5nLiAkMSw1LDEwLDIwJCB5ZWFycyBmb3IgdGhlIGZpcnN0IHR3byBwYXRpZW50cyBpbiB0aGUgdGVzdCBzZXQ6CmBgYHtyfQp0aW1lcyA9IGMoMSw1LDEwLDIwKQpwcmVkJGRpc3RyJHN1cnZpdmFsKHRpbWVzKVssYygxLDIpXQoKIyBzYW1lIGxvZ2ljIGZvciB0aGUgY3VtdWxhdGl2ZSBoYXphcmQKIyBwcmVkJGRpc3RyJGN1bUhhemFyZCh0aW1lcylbLGMoMSwyKV0KYGBgCmBgYAogICAgICAgIFssMV0gICAgICBbLDJdCjEgIDAuOTk5MzM1NyAwLjk5OTU4NTQKNSAgMC45OTI1OTg5IDAuOTk1Mzc1NAoxMCAwLjk4MDQwMzUgMC45ODc3MjY3CjIwIDAuOTYzMzU0OCAwLjk3Njk3MzgKYGBgCgojIyMgRGlzY3JpbWluYXRpb24gbWV0cmljcyB7LX0KCldlIHdhbnQgdG8gdGVzdCBvdXIgTGFzc28gQ294IG1vZGVsIGFuZCBzZWUgaG93IHdlbGwgaXQgd2FzIGFibGUgdG8gKipkaXNjcmltaW5hdGUgdGhlIHBhdGllbnRzIGluIHRoZSB0ZXN0IHNldCoqLgpGb3IgdGhpcyB3ZSBjYW4gdXNlIHRoZSAkbHAkIHByZWRpY3Rpb25zIG9mIExhc3NvIENveCBtb2RlbCBhbmQgbWV0cmljcyBzdWNoIGFzIHRoZSAodGltZS1kZXBlbmRlbnQpIEMtaW5kZXggYW5kICh0aW1lLWRlcGVuZGVudCkgQVVDLgoKPGZvbnQgc2l6ZT0iNCI+ICoqSGFycmVsbCdzIEMtaW5kZXgqKiBbQEhhcnJlbGwxOTgyXTogPC9mb250PiAKYGBge3J9CmhhcnJlbGxfYyA9IG1zcignc3Vydi5jaW5kZXgnKQpoYXJyZWxsX2MkaWQgPSAnc3Vydi5jaW5kZXguaGFycmVsbCcKCiMgaGFycmVsbF9jICMgZ2V0IHNvbWUgZGV0YWlscyBhYm91dCB0aGUgbWVhc3VyZQojIGhhcnJlbGxfYyRtaW5pbWl6ZSAjIEZBTFNFID0+IGhpZ2hlciBDLWluZGV4IGlzIGJldHRlcgojIGhhcnJlbGxfYyRyYW5nZSAjIFswLCAxXSA9PiBbbWluLCBtYXhdCiMgaGFycmVsbF9jJHByZWRpY3RfdHlwZSAjIHVzZXMgdGhlICRjcmFuayQgcHJlZGljdGlvbnMgKGVxdWFsIHRvICRscCQgZm9yIExhc3NvIENveAoKcHJlZCRzY29yZShoYXJyZWxsX2MpCmBgYApgYGAKc3Vydi5jaW5kZXguaGFycmVsbCAKICAgICAgICAgIDAuNjE4ODI0NCAKYGBgCgo8Zm9udCBzaXplPSI0Ij4gKipVbm8ncyBDLWluZGV4KiogW0BVbm8yMDExXTogKGFjcm9zcyBhbGwgdGltZSBwb2ludHMgb2YgdGhlIHRlc3Qgc2V0KTogPC9mb250PiAKYGBge3J9CnVub19jID0gbXNyKCdzdXJ2LmNpbmRleCcsIHdlaWdodF9tZXRoID0gJ0cyJykKdW5vX2MkaWQgPSAnc3Vydi5jaW5kZXgudW5vJwoKIyBVbm8ncyBDIG5lZWRzIHRoZSB0cmFpbiBkYXRhCnByZWQkc2NvcmUodW5vX2MsIHRhc2sgPSB0YXNrLCB0cmFpbl9zZXQgPSBzcGxpdCR0cmFpbikKYGBgCmBgYApzdXJ2LmNpbmRleC51bm8gCiAgICAgIDAuNjAwNDQ1OSAKYGBgCgo8Zm9udCBzaXplPSI0Ij4gKipVbm8ncyBJbnRlZ3JhdGVkIEFVQyoqIFtAVW5vMjAwN10gKGFjcm9zcyBhbGwgdGltZSBwb2ludHMgb2YgdGhlIHRlc3Qgc2V0KTogPC9mb250PiAKYGBge3J9CnVub19pYXVjID0gbXNyKCdzdXJ2LnVub19hdWMnKQp1bm9faWF1YyRpZCA9ICdzdXJ2LnVub19pYXVjJwojIHVub19pYXVjJHBhcmFtX3NldCR2YWx1ZXMkaW50ZWdyYXRlZCAjIGludGVncmF0ZWQgPSBUUlVFIGJ5IGRlZmF1bHQKIyBzb3J0KHVuaXF1ZShwcmVkJHRydXRoWywxXSkpICMgdGltZSBwb2ludHMgdXNlZAoKIyB1bm9faWF1YyRwcm9wZXJ0aWVzICMgbmVlZHMgdGhlIHRyYWluIGRhdGEKcHJlZCRzY29yZSh1bm9faWF1YywgdGFzayA9IHRhc2ssIHRyYWluX3NldCA9IHNwbGl0JHRyYWluKQpgYGAKYGBgCnN1cnYudW5vX2lhdWMgCiAgICAwLjY2NDU3MTkgCmBgYAoKPGZvbnQgc2l6ZT0iNCI+ICoqVW5vJ3MgQVVDIGF0IGEgc3BlY2lmaWMgdGltZSBwb2ludCoqLCBlLmcuICQxMCQgeWVhcnM6IDwvZm9udD4gCmBgYHtyfQp1bm9fYXVjID0gbXNyKCdzdXJ2LnVub19hdWMnLCBpbnRlZ3JhdGVkID0gRkFMU0UsIHRpbWVzID0gMTApCnVub19hdWMkaWQgPSAnc3Vydi51bm9fYXVjLjEwJwoKIyBuZWVkcyB0aGUgdHJhaW4gZGF0YQpwcmVkJHNjb3JlKHVub19hdWMsIHRhc2sgPSB0YXNrLCB0cmFpbl9zZXQgPSBzcGxpdCR0cmFpbikKYGBgCmBgYApzdXJ2LnVub19hdWMuMTAgCiAgICAgIDAuNjc0OTA4MSAKYGBgCgojIyMgQ2FsaWJyYXRpb24gbWV0cmljcyB7LX0KCldlIHdhbnQgdG8gdGVzdCBob3cgd2VsbCBvdXIgTGFzc28gQ294IG1vZGVsIHdhcyAqKmNhbGlicmF0ZWQqKi4KVXN1YWxseSB3ZSBkZXJpdmUgYW4gZXN0aW1hdGlvbiBvZiB0aGUgZXJyb3IgYmV0d2VlbiB0aGUgc3Vydml2YWwgZGlzdHJpYnV0aW9ucyAoJGRpc3RyJCBwcmVkaWN0aW9ucykgb2YgdGhlIHBhdGllbnRzIGluIHRoZSB0ZXN0IHNldCBhbmQgdGhlaXIgYWN0dWFsIHN1cnZpdmFsIG91dGNvbWVzIChjb3JyZXNwb25kaW5nIHRvIHRoZSBzdXJ2aXZhbCB0YXNrJ3MgYHRpbWVgIGFuZCBgc3RhdHVzYCB2YXJpYWJsZXMpLgpUaGUgbW9zdCBmcmVxdWVudGx5IHVzZWQgbWV0cmljIGlzIHRoZSBCcmllciBTY29yZSBbQEdyYWYxOTk5XToKCjxmb250IHNpemU9IjQiPiAqKkludGVncmF0ZWQgQnJpZXIgU2NvcmUgKElCUykqKiAoYWNyb3NzIGFsbCB0aW1lIHBvaW50cyBvZiB0aGUgdGVzdCBzZXQpOiA8L2ZvbnQ+IApgYGB7cn0KaWJyaWVyID0gbXNyKCdzdXJ2LmJyaWVyJywgcHJvcGVyID0gVFJVRSkKIyBpYnJpZXIkaGVscCgpICMgc2VlIGRvY3VtZW50YXRpb24KIyBpYnJpZXIkcHJlZGljdF90eXBlICMgdXNlcyB0aGUgYGRpc3RyYCBwcmVkaWN0aW9ucwoKIyBiZXR0ZXIgdG8gdXNlIHRoZSB0cmFpbiBkYXRhIGZvciB0aGUgS2FwbGFuLU1laWVyIGVzdGltYXRpb24gb2YgdGhlIGNlbnNvcmluZyBkaXN0cmlidXRpb24sIGJ1dCBjYW4gdXNlIHRoZSB0ZXN0IHNldCBhcyB3ZWxsCnByZWQkc2NvcmUoaWJyaWVyLCB0YXNrID0gdGFzaywgdHJhaW5fc2V0ID0gc3BsaXQkdHJhaW4pCmBgYApgYGAKc3Vydi5ncmFmIAowLjQwNDQyODcgCmBgYAoKV2UgY2FuIGFsc28gZ2V0IHRoZSAqc3RhbmRhcmQgZXJyb3IqIG9mIElCUyAodGhlIGFib3ZlIHJlc3VsdCBpcyB0aGUgbWVhbiBhY3Jvc3MgYWxsIHRoZSB0ZXN0IHNldCdzIHBhdGllbnRzKSBhcyBmb2xsb3dzOgpgYGB7cn0KaWJyaWVyX3NlID0gbXNyKCdzdXJ2LmJyaWVyJywgcHJvcGVyID0gVFJVRSwgc2UgPSBUUlVFKQpwcmVkJHNjb3JlKGlicmllcl9zZSwgdGFzayA9IHRhc2ssIHRyYWluX3NldCA9IHNwbGl0JHRyYWluKQpgYGAKYGBgCiBzdXJ2LmdyYWYgCjAuMDIyNTM5MjcKYGBgCgo8Zm9udCBzaXplPSI0Ij4gKipCcmllciBTY29yZSBhdCBhIHNwZWNpZmljIHRpbWUgcG9pbnQqKiwgZS5nLiAkMTAkIHllYXJzOiA8L2ZvbnQ+IApgYGB7cn0KYnJpZXIxMCA9IG1zcignc3Vydi5icmllcicsIHByb3BlciA9IFRSVUUsIGludGVncmF0ZWQgPSBGQUxTRSwgdGltZXMgPSAxMCkKYnJpZXIxMCRpZCA9ICdzdXJ2LmdyYWYuMTAnCgojIGJldHRlciB0byB1c2UgdGhlIHRyYWluIGRhdGEgZm9yIHRoZSBLYXBsYW4tTWVpZXIgZXN0aW1hdGlvbiBvZiB0aGUgY2Vuc29yaW5nIGRpc3RyaWJ1dGlvbiwgYnV0IGNhbiB1c2UgdGhlIHRlc3Qgc2V0IGFzIHdlbGwKcHJlZCRzY29yZShicmllcjEwLCB0YXNrID0gdGFzaywgdHJhaW5fc2V0ID0gc3BsaXQkdHJhaW4pCmBgYApgYGAKc3Vydi5ncmFmLjEwIAogICAwLjQyNTI0NDIgCmBgYAoKPGZvbnQgc2l6ZT0iNCI+ICoqUmlnaHQtY2Vuc29yZWQgTG9nYXJpdGhtaWMgTG9zcyBzY29yZSoqIChSQ0xMKSBbQEF2YXRpMjAyMF06IDwvZm9udD4gCmBgYHtyfQpyY2xsID0gbXNyKCdzdXJ2LnJjbGwnKQpwcmVkJHNjb3JlKHJjbGwpCmBgYApgYGAKc3Vydi5yY2xsIAogNC42ODQ2NDQgCmBgYAoKPGZvbnQgc2l6ZT0iNCI+ICoqRC1jYWxpYnJhdGlvbioqIFtASHVtemEyMDIwXTogPC9mb250PiAKYGBge3J9CmRjYWwgPSBtc3IoJ3N1cnYuZGNhbGliJykKcHJlZCRzY29yZShkY2FsKQpgYGAKYGBgCnN1cnYuZGNhbGliIAogICAzMi4yNTk2MSAKYGBgCjo6OnsuaW5mby1ib3ggLm5vdGV9ClZpZXcgYWxsIGV2YWx1YXRpb24gbWV0cmljcyBmb3Igc3Vydml2YWwgZGF0YSBpbXBsZW1lbnRlZCBpbiBbKiptbHIzcHJvYmEqKl0oaHR0cHM6Ly9tbHIzcHJvYmEubWxyLW9yZy5jb20pIFtoZXJlXShodHRwczovL21scjNwcm9iYS5tbHItb3JnLmNvbS9yZWZlcmVuY2UvI3N1cnZpdmFsLW1lYXN1cmVzKQo6OjoKCiMjIyBVbmNlcnRhaW50eSBRdWFudGlmaWNhdGlvbiB7LX0KClNpbWlsYXIgcHJvY2VkdXJlIGFzIGZvbGxvd2VkIGluIGEgW3ByZXZpb3VzIHNlY3Rpb25dKCN1cTEpLgoKV2Ugd2lsbCBwZXJmb3JtIGEgKipzdHJhdGlmaWVkIHNwbGl0Kiogb2YgdGhlIEJSQ0EtVENHQSBzdXJ2aXZhbCB0YXNrIHRvIHRyYWluaW5nIGFuZCB0ZXN0IHNldHMgKHdpdGggYSAkODBcJS8yMFwlJCByYXRpbyBhcyBiZWZvcmUpLgpTdHJhdGlmaWNhdGlvbiBvbiB0aGUgY2Vuc29yaW5nIGluZGljYXRvciBgc3RhdHVzYCBpcyBpbXBvcnRhbnQgYmVjYXVzZSB3ZSB3YW50IG91ciB0cmFpbmluZyBhbmQgdGVzdCBzZXRzIHRvIGhhdmUgdGhlIHNhbWUgY2Vuc29yaW5nIGRpc3RyaWJ1dGlvbiBhcyB0aGUgaW5pdGlhbCBkYXRhc2V0LgpUaHVzIHdlIGNhbiBhdm9pZCBtZWFzdXJpbmcgcGVyZm9ybWFuY2Ugb24gdGVzdCBzZXRzIHdpdGggc2V2ZXJlbHkgZGlmZmVyZW50IGNlbnNvcmluZyBkaXN0cmlidXRpb25zIHRoYXQgbWlnaHQgaW5mbHVlbmNlIHRoZSBwZXJmb3JtYW5jZSBzY29yZXMuCgpTdHJhdGlmeSBzdXJ2aXZhbCB0YXNrIGJ5IGBzdGF0dXNgOgpgYGB7cn0KY294bGFzc29fZ3Jscm4kcmVzZXQoKSAjIHVuLXRyYWluIG1vZGVsCgp0YXNrJGNvbF9yb2xlcyRzdHJhdHVtID0gJ3N0YXR1cycKIyB0YXNrCmBgYAoKTmV4dCwgd2UgZGVmaW5lIHRoZSB0eXBlIG9mIHJlc2FtcGxpbmcgKGA/bWxyX3Jlc2FtcGxpbmdzX3N1YnNhbXBsaW5nYCksIHRyYWluIHRoZSBMYXNzbyBDb3ggbW9kZWwgb24gYWxsIHRyYWluaW5nIHNldHMgKCQxMDAkKSBhbmQgc3RvcmUgdGhlIGZpdHRlZCBtb2RlbHMgZm9yIGZlYXR1cmUgc2VsZWN0aW9uIGFuZCBldmFsdWF0aW9uOgpgYGB7ciwgcmVzdWx0cz0naGlkZSd9CiMgMTAwIHRpbWVzIHRyYWluL3Rlc3Qgc3BsaXQgKDgwJSBmb3IgdHJhaW5pbmcsIDIwJSBmb3IgdmFsaWRhdGlvbikKc3Vic2FtcGxpbmcgPSByc21wKCdzdWJzYW1wbGluZycsIHJlcGVhdHMgPSAxMDAsIHJhdGlvID0gMC44KQoKc2V0LnNlZWQoNDIpCnJyID0gbWxyMzo6cmVzYW1wbGUodGFzayA9IHRhc2ssIGxlYXJuZXIgPSBjb3hsYXNzb19ncmxybiwgCiAgcmVzYW1wbGluZyA9IHN1YnNhbXBsaW5nLCBzdG9yZV9tb2RlbHMgPSBUUlVFLCBzdG9yZV9iYWNrZW5kcyA9IFRSVUUpCmBgYAoKV2UgY2FuIHVzZSBhbGwgdGhlIGFmb3JlbWVudGlvbmVkIGV2YWx1YXRpb24gbWV0cmljcyB0byBtZWFzdXJlIHRoZSBwZXJmb3JtYW5jZSBvZiB0aGUgTGFzc28gQ294IG1vZGVscyBvbiB0aGUgJDEwMCQgZGlmZmVyZW50IHRlc3Qgc2V0cy4KTm90ZSB0aGF0IGlmIGEgbWV0cmljIG5lZWRzIHRoZSB0cmFpbmluZyBkYXRhc2V0IGl0IGlzIGF1dG9tYXRpY2FsbHkgcHJvdmlkZWQgYnkgdGhlIGBSZXNhbXBsZVJlc3VsdGAgb2JqZWN0IChgcnJgKToKYGBge3J9Cm1lYXN1cmVzID0gbGlzdChoYXJyZWxsX2MsIHVub19jLCB1bm9faWF1YywgdW5vX2F1YywgaWJyaWVyLCBicmllcjEwLCByY2xsLCBkY2FsKQoKcmVzID0gcnIkc2NvcmUobWVhc3VyZXMgPSBtZWFzdXJlcykKaGVhZChyZXMpCmBgYApgYGAKICAgICAgICAgICAgIHRhc2sgICB0YXNrX2lkICAgICAgICAgICAgbGVhcm5lciBsZWFybmVyX2lkCjE6IDxUYXNrU3Vydls1NV0+IEJSQ0EtVENHQSA8R3JhcGhMZWFybmVyWzM4XT4gIExhc3NvIENveAoyOiA8VGFza1N1cnZbNTVdPiBCUkNBLVRDR0EgPEdyYXBoTGVhcm5lclszOF0+ICBMYXNzbyBDb3gKMzogPFRhc2tTdXJ2WzU1XT4gQlJDQS1UQ0dBIDxHcmFwaExlYXJuZXJbMzhdPiAgTGFzc28gQ294CjQ6IDxUYXNrU3Vydls1NV0+IEJSQ0EtVENHQSA8R3JhcGhMZWFybmVyWzM4XT4gIExhc3NvIENveAo1OiA8VGFza1N1cnZbNTVdPiBCUkNBLVRDR0EgPEdyYXBoTGVhcm5lclszOF0+ICBMYXNzbyBDb3gKNjogPFRhc2tTdXJ2WzU1XT4gQlJDQS1UQ0dBIDxHcmFwaExlYXJuZXJbMzhdPiAgTGFzc28gQ294CiAgICAgICAgICAgICAgICAgICAgcmVzYW1wbGluZyByZXNhbXBsaW5nX2lkIGl0ZXJhdGlvbiAgICAgICAgICAgcHJlZGljdGlvbgoxOiA8UmVzYW1wbGluZ1N1YnNhbXBsaW5nWzIwXT4gICBzdWJzYW1wbGluZyAgICAgICAgIDEgPFByZWRpY3Rpb25TdXJ2WzIwXT4KMjogPFJlc2FtcGxpbmdTdWJzYW1wbGluZ1syMF0+ICAgc3Vic2FtcGxpbmcgICAgICAgICAyIDxQcmVkaWN0aW9uU3VydlsyMF0+CjM6IDxSZXNhbXBsaW5nU3Vic2FtcGxpbmdbMjBdPiAgIHN1YnNhbXBsaW5nICAgICAgICAgMyA8UHJlZGljdGlvblN1cnZbMjBdPgo0OiA8UmVzYW1wbGluZ1N1YnNhbXBsaW5nWzIwXT4gICBzdWJzYW1wbGluZyAgICAgICAgIDQgPFByZWRpY3Rpb25TdXJ2WzIwXT4KNTogPFJlc2FtcGxpbmdTdWJzYW1wbGluZ1syMF0+ICAgc3Vic2FtcGxpbmcgICAgICAgICA1IDxQcmVkaWN0aW9uU3VydlsyMF0+CjY6IDxSZXNhbXBsaW5nU3Vic2FtcGxpbmdbMjBdPiAgIHN1YnNhbXBsaW5nICAgICAgICAgNiA8UHJlZGljdGlvblN1cnZbMjBdPgogICBzdXJ2LmNpbmRleC5oYXJyZWxsIHN1cnYuY2luZGV4LnVubyBzdXJ2LnVub19pYXVjIHN1cnYudW5vX2F1Yy4xMCBzdXJ2LmdyYWYKMTogICAgICAgICAgIDAuNTY3OTE2NyAgICAgICAwLjYwOTAzMDQgICAgIDAuNjYyODM1MCAgICAgICAwLjQ3MTkzMzUgMC4zMjU1MTgxCjI6ICAgICAgICAgICAwLjU0MjIxMzEgICAgICAgMC40ODg0NjAzICAgICAwLjQwMjM2ODQgICAgICAgMC41NjUyNTg4IDAuMzE0ODk5MgozOiAgICAgICAgICAgMC43NjA0MDQ5ICAgICAgIDAuNTc0MDU1NiAgICAgMC41OTQxOTQ4ICAgICAgIDAuNTIzNTQzOSAwLjI4NTUxNTEKNDogICAgICAgICAgIDAuNjYxMDE2OSAgICAgICAwLjUyNzc3MzYgICAgIDAuNTM2MDY5MCAgICAgICAwLjUxMTAwMzIgMC4yOTcyNzE5CjU6ICAgICAgICAgICAwLjU4MDAwNzMgICAgICAgMC41NjU1MDc2ICAgICAwLjYxNjA3NDMgICAgICAgMC41Mzg4MzkzIDAuMzUxODUwNQo2OiAgICAgICAgICAgMC41NDI3ODM3ICAgICAgIDAuNjk3NTc0MCAgICAgMC42NDk0Nzc5ICAgICAgIDAuNjQwMDMyOCAwLjIwMzU2MDkKICAgc3Vydi5ncmFmLjEwIHN1cnYucmNsbCAgc3Vydi5kY2FsaWIKMTogICAgMC42MTYxODI1ICA2LjAzODkwOSAxLjAyNjkwMWUrMDcKMjogICAgMC40NDczMTA0ICA1LjQwMDI1MyAxLjA1MDQyN2UrMDQKMzogICAgMC4yOTY5NzY2ICA0Ljk1MzUyOCAyLjU0NDExNmUrMDEKNDogICAgMC4yMzY1MzIyICA0Ljk1MzgzMCAyLjI3NTA0MGUrMDEKNTogICAgMC40Mzg3MTY1ICA0Ljk0MzQ0NiAzLjM3MDUxMGUrMDEKNjogICAgMC40MjI4MTY5ICA1LjQzNDk3MCA0LjIyMzc0MmUrMDIKYGBgCldlIGV4dHJhY3QgYW5kIHZpc3VhbGl6ZSB0aGUgZGlzY3JpbWluYXRpb24gYW5kIGNhbGlicmF0aW9uIChyZXNhbXBsZWQpIHBlcmZvcm1hbmNlIG9mIG91ciBMYXNzbyBDb3ggbW9kZWwgdXNpbmcgc2V2ZXJhbCBldmFsdWF0aW9uIG1ldHJpY3M6CmBgYHtyfQpzZXQuc2VlZCg0MikKCiMgQy1pbmRleGVzLCBBVUNzIChpbnRlZ3JhdGVkIGFuZCBhdCB0ID0gMTAgeWVhcnMpCnJlc1ssIC4oc3Vydi5jaW5kZXguaGFycmVsbCwgc3Vydi5jaW5kZXgudW5vLCBzdXJ2LnVub19pYXVjLCBzdXJ2LnVub19hdWMuMTApXSAlPiUgCiAgdGlkeXI6OnBpdm90X2xvbmdlcihjb2xzID0gdGlkeXNlbGVjdDo6ZXZlcnl0aGluZygpLCAKICAgIG5hbWVzX3RvID0gJ01lYXN1cmUnLCB2YWx1ZXNfdG8gPSAnVmFsdWUnKSAlPiUKICBtdXRhdGUoTWVhc3VyZSA9IGNhc2Vfd2hlbigKICAgIE1lYXN1cmUgPT0gJ3N1cnYuY2luZGV4LmhhcnJlbGwnIH4gJ0hhcnJlbGxcJ3MgQy1pbmRleCcsCiAgICBNZWFzdXJlID09ICdzdXJ2LmNpbmRleC51bm8nIH4gJ1Vub1wncyBDLWluZGV4JywKICAgIE1lYXN1cmUgPT0gJ3N1cnYudW5vX2lhdWMnIH4gJ1Vub1wncyBJbnRlZ3JhdGVkIEFVQycsCiAgICBNZWFzdXJlID09ICdzdXJ2LnVub19hdWMuMTAnIH4gJ1Vub1wncyBBVUMgKHQgPSAxMCB5ZWFycyknLAogICkpICU+JQogICBtdXRhdGUoTWVhc3VyZSA9IGZhY3RvcihNZWFzdXJlLCBsZXZlbHMgPSBjKAogICAgICdIYXJyZWxsXCdzIEMtaW5kZXgnLAogICAgICdVbm9cJ3MgQy1pbmRleCcsCiAgICAgJ1Vub1wncyBJbnRlZ3JhdGVkIEFVQycsCiAgICAgJ1Vub1wncyBBVUMgKHQgPSAxMCB5ZWFycyknKSkpICU+JQogIGdncGxvdChhZXMoeCA9IE1lYXN1cmUsIHkgPSBWYWx1ZSwgZmlsbCA9IE1lYXN1cmUpKSArCiAgICBnZW9tX2JveHBsb3QoKSArIAogICAgeWxpbShjKDAuMiwgMC44KSkgKyAKICAgIGdlb21faGxpbmUoeWludGVyY2VwdCA9IDAuNSwgY29sb3IgPSAncmVkJywgbGluZXR5cGUgPSAnZGFzaGVkJykgKwogICAgdGhlbWVfYncoYmFzZV9zaXplID0gMTQpICsgCiAgICBsYWJzKHRpdGxlID0gJ0Rpc2NyaW1pbmF0aW9uIE1lYXN1cmVzJykgKwogICAgdGhlbWUoYXhpcy50ZXh0LnggPSBlbGVtZW50X2JsYW5rKCkpCmBgYAohW19EaXNjcmltaW5hdGlvbiBwZXJmb3JtYW5jZSBvZiBMYXNzbyBDb3ggb24gdGhlIFRDR0EtQlJDQSBkYXRhc2V0IChleHByZXNzaW9uIGRhdGEgb2YgdGhlIFBBTTUwIGdlbmVzIGFuZCB0aGUgdmFyaWFibGVzIGFnZSBhbmQgZXRobmljaXR5KS4gUGVyZm9ybWFuY2UgbWV0cmljcyB1c2VkIGFyZSBIYXJyZWxsJ3MgQy1pbmRleCwgVW5vJ3MgQy1pbmRleCwgVW5vJ3MgSW50ZWdyYXRlZCBBVUMgYW5kIFVubydzIEFVQyBhdCAxMCB5ZWFycy4gVGhlIGRhdGFzZXQgd2FzIHNwbGl0IHRvIHRyYWluaW5nL3ZhbGlkYXRpb24gc2V0cyAxMDAgdGltZXMgdG8gYWxsb3cgZm9yIHRoZSBxdWFudGlmaWNhdGlvbiBvZiB1bmNlcnRhaW50eSBpbiB0aGUgZGlmZmVyZW50IHBlcmZvcm1hbmNlIGVzdGltYXRlcy5fXShmaWcvbWxyM19kaXNjcmltaW5hdGlvbl9tc3JzLnBuZyl7d2lkdGg9ODAlfQoKYGBge3IsIGZpZy5zaG93PSdob2xkJywgb3V0LndpZHRoPSc1MCUnfQojIGRpZmZlcmVudCBzY2FsZXMgZm9yIGVhY2ggbWVhc3VyZSwgc28gd2Ugc2VwYXJhdGUgdGhlIHBsb3RzCnNldC5zZWVkKDQyKQoKIyBJbnRlZ3JhdGVkIEJyaWVyIFNjb3JlIGFuZCBCcmllciBTY29yZSBhdCB0ID0gMTAgeWVhcnMKcmVzWywgLihzdXJ2LmdyYWYsIHN1cnYuZ3JhZi4xMCldICU+JSAKICB0aWR5cjo6cGl2b3RfbG9uZ2VyKGNvbHMgPSB0aWR5c2VsZWN0OjpldmVyeXRoaW5nKCksIAogICAgbmFtZXNfdG8gPSAnTWVhc3VyZScsIHZhbHVlc190byA9ICdWYWx1ZScpICU+JQogIG11dGF0ZShNZWFzdXJlID0gY2FzZV93aGVuKAogICAgTWVhc3VyZSA9PSAnc3Vydi5ncmFmJyB+ICdJQlMnLAogICAgTWVhc3VyZSA9PSAnc3Vydi5ncmFmLjEwJyB+ICdCUyh0PTEwKScKICApKSAlPiUKICBnZ3Bsb3QoYWVzKHggPSBNZWFzdXJlLCB5ID0gVmFsdWUsIGZpbGwgPSBNZWFzdXJlKSkgKwogICAgZ2VvbV9ib3hwbG90KHNob3cubGVnZW5kID0gRkFMU0UpICsgCiAgICBnZW9tX2ppdHRlcihjb2xvciA9ICdibHVlJywgc2l6ZSA9IDAuNSwgYWxwaGEgPSAwLjUsIHNob3cubGVnZW5kID0gRkFMU0UpICsKICAgIGxhYnModGl0bGUgPSAnSW50ZWdyYXRlZCBCcmllciBTY29yZSB2cyBCcmllciBTY29yZSAodCA9IDEwIHllYXJzKScpICsKICAgIHRoZW1lX2J3KGJhc2Vfc2l6ZSA9IDE0KSArIAogICAgdGhlbWUoYXhpcy50aXRsZS54ID0gZWxlbWVudF9ibGFuaygpKQoKIyBSQ0xMCnJlc1ssIC4oc3Vydi5yY2xsKV0gJT4lIAogIHRpZHlyOjpwaXZvdF9sb25nZXIoY29scyA9IHRpZHlzZWxlY3Q6OmV2ZXJ5dGhpbmcoKSwgCiAgICBuYW1lc190byA9ICdNZWFzdXJlJywgdmFsdWVzX3RvID0gJ1ZhbHVlJykgJT4lCiAgbXV0YXRlKE1lYXN1cmUgPSBjYXNlX3doZW4oCiAgICBNZWFzdXJlID09ICdzdXJ2LnJjbGwnIH4gJ1JDTEwnCiAgKSkgJT4lCiAgZ2dwbG90KGFlcyh4ID0gTWVhc3VyZSwgeSA9IFZhbHVlKSkgKwogICAgZ2VvbV9ib3hwbG90KHNob3cubGVnZW5kID0gRkFMU0UpICsgCiAgICBnZW9tX2ppdHRlcihjb2xvciA9ICdibHVlJywgc2l6ZSA9IDAuNSwgYWxwaGEgPSAwLjUsIHNob3cubGVnZW5kID0gRkFMU0UpICsKICAgIGxhYnModGl0bGUgPSAnUmlnaHQtY2Vuc29yZWQgTG9nIExvc3MnKSArCiAgICB0aGVtZV9idyhiYXNlX3NpemUgPSAxNCkgKwogICAgdGhlbWUoYXhpcy50aXRsZS54ID0gZWxlbWVudF9ibGFuaygpKQpgYGAKPHAgYWxpZ249ImxlZnQiPgogIDxpbWcgYWx0PSIxIiBzcmM9Ii4vZmlnL21scjNfY2FsaWJyYXRpb25fQlMucG5nIiB3aWR0aD0iNDklIj4KICA8aW1nIGFsdD0iMiIgc3JjPSIuL2ZpZy9tbHIzX2NhbGlicmF0aW9uX1JDTEwucG5nIiB3aWR0aD0iNDklIj4KICA8aT5DYWxpYnJhdGlvbiBwZXJmb3JtYW5jZSBvZiBMYXNzbyBDb3ggb24gdGhlIFRDR0EtQlJDQSBkYXRhc2V0IChleHByZXNzaW9uIGRhdGEgb2YgdGhlIFBBTTUwIGdlbmVzIGFuZCB0aGUgdmFyaWFibGVzIGFnZSBhbmQgZXRobmljaXR5KS4gUGVyZm9ybWFuY2UgbWV0cmljcyB1c2VkIGFyZSB0aGUgSW50ZWdyYXRlZCBCcmllciBTY29yZSAoSUJTKSwgdGhlIEJyaWVyIFNjb3JlIGF0IDEwIHllYXJzIGFuZCB0aGUgUmlnaHQtQ2Vuc29yZWQgTG9nYXJpdGhtaWMgTG9zcyAoUkNMTCkuIFRoZSBkYXRhc2V0IHdhcyBzcGxpdCB0byB0cmFpbmluZy92YWxpZGF0aW9uIHNldHMgMTAwIHRpbWVzIHRvIGFsbG93IGZvciB0aGUgcXVhbnRpZmljYXRpb24gb2YgdW5jZXJ0YWludHkgaW4gdGhlIGRpZmZlcmVudCBwZXJmb3JtYW5jZSBlc3RpbWF0ZXMuPC9pPgo8L3A+CgojIyMgRmVhdHVyZSBzdGFiaWxpdHkgYW5hbHlzaXMgey19CgpXZSBjYW4gZXh0cmFjdCB0aGUgc2VsZWN0ZWQgZmVhdHVyZXMgZnJvbSBhbGwgJDEwMCQgdHJhaW5lZCBMYXNzbyBDb3ggbW9kZWxzIGFuZCBjcmVhdGUgYSBmcmVxdWVuY3kgc2VsZWN0aW9uIHRhYmxlOgpgYGB7cn0KIyBnZXQgc2VsZWN0ZWQgZmVhdHVyZXMgZnJvbSBhbGwgdHJhaW5lZCBsZWFybmVycyBpbiBhIGxpc3QKc2ZfbGlzdCA9IGxhcHBseShyciRsZWFybmVycywgZnVuY3Rpb24obGVhcm5lcikgewogIGxlYXJuZXIkZ3JhcGhfbW9kZWwkcGlwZW9wcyRzdXJ2LmN2X2dsbW5ldCRsZWFybmVyX21vZGVsJHNlbGVjdGVkX2ZlYXR1cmVzKCkKfSkKCiMgbWFrZSBmcmVxdWVuY3kgc2VsZWN0aW9uIHRhYmxlCm4gPSBsZW5ndGgoc2ZfbGlzdCkKZnNfcmVzID0gc29ydCh0YWJsZSh1bmxpc3Qoc2ZfbGlzdCkpLCBkZWNyZWFzaW5nID0gVFJVRSkKdGltZXMgPSBhcy52ZWN0b3IodW5uYW1lKGZzX3JlcykpCnRpYmJsZTo6dGliYmxlKGZlYXRfbmFtZSA9IG5hbWVzKGZzX3JlcyksIHRpbWVzID0gdGltZXMsIGZyZXEgPSB0aW1lcy9uKQpgYGAKYGBgCiMgQSB0aWJibGU6IDM1IMOXIDMKICAgZmVhdF9uYW1lIHRpbWVzICBmcmVxCiAgIDxjaHI+ICAgICA8aW50PiA8ZGJsPgogMSBhZ2UgICAgICAgICAxMDAgIDEgICAKIDIgZXRobmljaXR5ICAgMTAwICAxICAgCiAzIFVCRTJUICAgICAgICA1MyAgMC41MwogNCBPUkM2TCAgICAgICAgNDggIDAuNDgKIDUgQU5MTiAgICAgICAgIDQyICAwLjQyCiA2IEVSQkIyICAgICAgICA0MCAgMC40IAogNyBHUFIxNjAgICAgICAgMzUgIDAuMzUKIDggRkdGUjQgICAgICAgIDMzICAwLjMzCiA5IENFUDU1ICAgICAgICAzMiAgMC4zMgoxMCBVQkUyQyAgICAgICAgMzAgIDAuMyAKIyDigKYgd2l0aCAyNSBtb3JlIHJvd3MKYGBgCgpBcyBgYWdlYCBhbmQgYGV0aG5pY2l0eWAgd2VyZSBub3QgcGVuYWxpemVkLCB0aGV5IGhhdmUgbm9uLXplcm8gY29lZmZpY2llbnRzIGluIGFsbCBMYXNzbyBDb3ggbW9kZWxzIGFuZCB0aGVyZWZvcmUgYXJlIGluY2x1ZGVkIGluIGFsbCBzZWxlY3RlZCBmZWF0dXJlIHNldHMuCgpMYXN0bHksIHdlIGNhbiB1c2UgdGhlIGBSYCBwYWNrYWdlIFsqKnN0YWJtKipdKGh0dHBzOi8vQ1JBTi5SLXByb2plY3Qub3JnL3BhY2thZ2U9c3RhYm0pIFtAc3RhYm1dIHRvIGFzc2VzcyBob3cgc2ltaWxhciB0aGUgJDEwMCQgc2VsZWN0ZWQgZmVhdHVyZSBzZXRzIHdlcmUuCldlIHdpbGwgZGVtb25zdHJhdGUgdGhlIHVzZSBvZiB0aHJlZSBtZXRyaWNzIHdoaWNoIG1lYXN1cmUgdGhlICpzdGFiaWxpdHkqIG9mIHRoZSBMYXNzbyBDb3gncyBmZWF0dXJlIHNlbGVjdGlvbiBvbiB0aGUgVENHQS1CUkNBIGRhdGFzZXQ6CgoxLiBUaGUgSmFjY2FyZCBpbmRleAoyLiBOb2d1ZWlyYSdzIG1ldHJpYyAoY29ycmVjdGVkIGZvciBjaGFuY2UsIGkuZS4gaW5kZXBlbmRlbnQgb2YgdGhlIG51bWJlciBvZiBmZWF0dXJlczsgQE5vZ3VlaXJhMjAxOCkKMy4gWnVja25pY2sncyBtZXRyaWMgKGV4dGVuc2lvbiBvZiBKYWNjYXJkIGluZGV4IHRoYXQgY29uc2lkZXJzIHRoZSBjb3JyZWxhdGlvbiBiZXR3ZWVuIHRoZSBmZWF0dXJlczsgQFp1Y2tuaWNrMjAwOCk6CgpgYGB7ciwgd2FybmluZz1GQUxTRX0Kc2V0LnNlZWQoNDIpCmphYyA9IHN0YWJtOjpzdGFiaWxpdHlKYWNjYXJkKGZlYXR1cmVzID0gc2ZfbGlzdCwgY29ycmVjdGlvbi5mb3IuY2hhbmNlID0gJ25vbmUnKQpub2cgPSBzdGFibTo6c3RhYmlsaXR5Tm9ndWVpcmEoZmVhdHVyZXMgPSBzZl9saXN0LCBwID0gbGVuZ3RoKHRhc2skZmVhdHVyZV9uYW1lcykpCgojIFNpbWlsYXJpdHkgb2YgZWFjaCBwYWlyIG9mIGZlYXR1cmVzIHVzaW5nIFBlYXJzb24gY29ycmVsYXRpb24Kc2ltLm1hdCA9IGFicyhzdGF0czo6Y29yKHggPSB0YXNrJGRhdGEoY29scyA9IHRhc2skZmVhdHVyZV9uYW1lcyksIG1ldGhvZCA9ICdwJykpCnp1Y2sgPSBzdGFibTo6c3RhYmlsaXR5WnVja25pY2soZmVhdHVyZXMgPSBzZl9saXN0LCBzaW0ubWF0ID0gc2ltLm1hdCwgCiAgdGhyZXNob2xkID0gMC45LCBjb3JyZWN0aW9uLmZvci5jaGFuY2UgPSAnZXN0aW1hdGUnLCBOID0gMTAwKQoKdGliYmxlOjp0aWJibGUoamFjY2FyZCA9IGphYywgbm9ndWVpcmEgPSBub2csIHp1Y2tuaWNrID0genVjaykKYGBgCmBgYAojIEEgdGliYmxlOiAxIMOXIDMKICBqYWNjYXJkIG5vZ3VlaXJhIHp1Y2tuaWNrCiAgICA8ZGJsPiAgICA8ZGJsPiAgICA8ZGJsPgoxICAgMC40MzkgICAgMC40MTIgICAgMC40MDIKYGBgCgpGcm9tIHRoZSBhYm92ZSB2YWx1ZXMgd2UgY29uY2x1ZGUgdGhhdCB0aGUgc3RhYmlsaXR5IG9mIExhc3NvIENveCdzIGZlYXR1cmUgc2VsZWN0aW9uIGlzIG5laXRoZXIgcG9vciBub3IgZXhjZWxsZW50IGJ1dCBzb21ld2hlcmUgaW4gYmV0d2Vlbi4KCiMgUiBzZXNzaW9uIGluZm8gey19CgpgYGB7ciwgaW5jbHVkZT1GQUxTRSwgbWVzc2FnZT1GQUxTRX0KIyBwdXR0aW5nIGFsbCBsaWJyYXJpZXMgaGVyZSBmb3IgdGhlIHNlc3Npb24gaW5mbwpsaWJyYXJ5KCJUQ0dBYmlvbGlua3MiKQpsaWJyYXJ5KCJTdW1tYXJpemVkRXhwZXJpbWVudCIpCmxpYnJhcnkoIkRFU2VxMiIpCmxpYnJhcnkoImRwbHlyIikKbGlicmFyeSgiZ2dwbG90MiIpCmxpYnJhcnkoInN1cnZpdmFsIikKbGlicmFyeSgic3Vydm1pbmVyIikKbGlicmFyeSgiTTNDIikKbGlicmFyeSgiZ2xtbmV0IikKbGlicmFyeSgicGxvdG1vIikKbGlicmFyeSgiZ3JwcmVnIikKbGlicmFyeSgiU0dMIikKbGlicmFyeSgicHNiY0dyb3VwIikKbGlicmFyeSgiR0dhbGx5IikKbGlicmFyeSgiQmhHTE0iKQpsaWJyYXJ5KCJyaXNrc2V0Uk9DIikKbGlicmFyeSgicmlza1JlZ3Jlc3Npb24iKQpsaWJyYXJ5KCJwZXBlcnIiKQpsaWJyYXJ5KCJjMDYwIikKbGlicmFyeSgicm1zIikKbGlicmFyeSgic3VydkFVQyIpCmxpYnJhcnkoInJlZ3Bsb3QiKQpsaWJyYXJ5KCJtbHIzdmVyc2UiKQpsaWJyYXJ5KCJtbHIzcHJvYmEiKQpsaWJyYXJ5KCJtbHIzZXh0cmFsZWFybmVycyIpCmxpYnJhcnkoInN0YWJtIikKYGBgCgpgYGB7cn0Kc2Vzc2lvbkluZm8oKQpgYGAKYGBgClIgdmVyc2lvbiA0LjIuMSAoMjAyMi0wNi0yMykKUGxhdGZvcm06IHg4Nl82NC1wYy1saW51eC1nbnUgKDY0LWJpdCkKUnVubmluZyB1bmRlcjogVWJ1bnR1IDIwLjA0LjUgTFRTCgpNYXRyaXggcHJvZHVjdHM6IGRlZmF1bHQKQkxBUzogICAvdXNyL2xpYi94ODZfNjQtbGludXgtZ251L2JsYXMvbGliYmxhcy5zby4zLjkuMApMQVBBQ0s6IC91c3IvbGliL3g4Nl82NC1saW51eC1nbnUvbGFwYWNrL2xpYmxhcGFjay5zby4zLjkuMAoKbG9jYWxlOgogWzFdIExDX0NUWVBFPWVuX1VTLlVURi04ICAgICAgIExDX05VTUVSSUM9QyAgICAgICAgICAgICAgIExDX1RJTUU9ZW5fVVMuVVRGLTggICAgICAgIExDX0NPTExBVEU9ZW5fVVMuVVRGLTggICAgCiBbNV0gTENfTU9ORVRBUlk9ZW5fVVMuVVRGLTggICAgTENfTUVTU0FHRVM9ZW5fVVMuVVRGLTggICAgTENfUEFQRVI9ZW5fVVMuVVRGLTggICAgICAgTENfTkFNRT1DICAgICAgICAgICAgICAgICAKIFs5XSBMQ19BRERSRVNTPUMgICAgICAgICAgICAgICBMQ19URUxFUEhPTkU9QyAgICAgICAgICAgICBMQ19NRUFTVVJFTUVOVD1lbl9VUy5VVEYtOCBMQ19JREVOVElGSUNBVElPTj1DICAgICAgIAoKYXR0YWNoZWQgYmFzZSBwYWNrYWdlczoKWzFdIHN0YXRzNCAgICBzdGF0cyAgICAgZ3JhcGhpY3MgIGdyRGV2aWNlcyB1dGlscyAgICAgZGF0YXNldHMgIG1ldGhvZHMgICBiYXNlICAgICAKCm90aGVyIGF0dGFjaGVkIHBhY2thZ2VzOgogWzFdIHN0YWJtXzEuMi4xICAgICAgICAgICAgICAgICBtbHIzZXh0cmFsZWFybmVyc18wLjYuMSAgICAgbWxyM3Byb2JhXzAuNS4yICAgICAgICAgICAgCiBbNF0gbWxyM3ZlcnNlXzAuMi43ICAgICAgICAgICAgIG1scjNfMC4xNC4xICAgICAgICAgICAgICAgICByZWdwbG90XzEuMSAgICAgICAgICAgICAgICAKIFs3XSBzdXJ2QVVDXzEuMS0xICAgICAgICAgICAgICAgcm1zXzYuMy0wICAgICAgICAgICAgICAgICAgIFNwYXJzZU1fMS44MSAgICAgICAgICAgICAgIApbMTBdIEhtaXNjXzQuNy0xICAgICAgICAgICAgICAgICBsYXR0aWNlXzAuMjAtNDUgICAgICAgICAgICAgYzA2MF8wLjItOSAgICAgICAgICAgICAgICAgClsxM10gcGVwZXJyXzEuNCAgICAgICAgICAgICAgICAgIHNub3dmYWxsXzEuODQtNi4yICAgICAgICAgICBzbm93XzAuNC00ICAgICAgICAgICAgICAgICAKWzE2XSByaXNrUmVncmVzc2lvbl8yMDIyLjA5LjIzICAgcmlza3NldFJPQ18xLjAuNC4xICAgICAgICAgIE1BU1NfNy4zLTU3ICAgICAgICAgICAgICAgIApbMTldIEJoR0xNXzEuMS4wICAgICAgICAgICAgICAgICBHR2FsbHlfMi4xLjIgICAgICAgICAgICAgICAgcHNiY0dyb3VwXzEuNSAgICAgICAgICAgICAgClsyMl0gbXZ0bm9ybV8xLjEtMyAgICAgICAgICAgICAgIFN1cHBEaXN0c18xLjEtOS43ICAgICAgICAgICBMZWFybkJheWVzXzIuMTUuMSAgICAgICAgICAKWzI1XSBTR0xfMS4zICAgICAgICAgICAgICAgICAgICAgZ3JwcmVnXzMuNC4wICAgICAgICAgICAgICAgIHBsb3Rtb18zLjYuMiAgICAgICAgICAgICAgIApbMjhdIFRlYWNoaW5nRGVtb3NfMi4xMiAgICAgICAgICBwbG90cml4XzMuOC0yICAgICAgICAgICAgICAgRm9ybXVsYV8xLjItNCAgICAgICAgICAgICAgClszMV0gZ2xtbmV0XzQuMS00ICAgICAgICAgICAgICAgIE1hdHJpeF8xLjUtMSAgICAgICAgICAgICAgICBNM0NfMS4yMC4wICAgICAgICAgICAgICAgICAKWzM0XSBzdXJ2bWluZXJfMC40LjkgICAgICAgICAgICAgZ2dwdWJyXzAuNC4wICAgICAgICAgICAgICAgIHN1cnZpdmFsXzMuNC0wICAgICAgICAgICAgIApbMzddIGdncGxvdDJfMy40LjAgICAgICAgICAgICAgICBkcGx5cl8xLjAuMTAgICAgICAgICAgICAgICAgREVTZXEyXzEuMzguMyAgICAgICAgICAgICAgCls0MF0gU3VtbWFyaXplZEV4cGVyaW1lbnRfMS4yOC4wIEJpb2Jhc2VfMi41OC4wICAgICAgICAgICAgICBHZW5vbWljUmFuZ2VzXzEuNTAuMiAgICAgICAKWzQzXSBHZW5vbWVJbmZvRGJfMS4zNC42ICAgICAgICAgSVJhbmdlc18yLjMyLjAgICAgICAgICAgICAgIFM0VmVjdG9yc18wLjM2LjEgICAgICAgICAgIApbNDZdIEJpb2NHZW5lcmljc18wLjQ0LjAgICAgICAgICBNYXRyaXhHZW5lcmljc18xLjEwLjAgICAgICAgbWF0cml4U3RhdHNfMC42My4wICAgICAgICAgCls0OV0gVENHQWJpb2xpbmtzXzIuMjUuMyAgICAgICAgCgpsb2FkZWQgdmlhIGEgbmFtZXNwYWNlIChhbmQgbm90IGF0dGFjaGVkKToKICBbMV0gcmFwcGRpcnNfMC4zLjMgICAgICAgICAgICAgIHZpb3Bsb3RfMC40LjAgICAgICAgICAgICAgICB0aWR5cl8xLjIuMSAgICAgICAgICAgICAgICAKICBbNF0gYml0NjRfNC4wLjUgICAgICAgICAgICAgICAgIGtuaXRyXzEuNDAgICAgICAgICAgICAgICAgICBtdWx0Y29tcF8xLjQtMjAgICAgICAgICAgICAKICBbN10gRGVsYXllZEFycmF5XzAuMjQuMCAgICAgICAgIGRhdGEudGFibGVfMS4xNC42ICAgICAgICAgICBycGFydF80LjEuMTkgICAgICAgICAgICAgICAKIFsxMF0gS0VHR1JFU1RfMS4zOC4wICAgICAgICAgICAgIFJDdXJsXzEuOTgtMS45ICAgICAgICAgICAgICBkb1BhcmFsbGVsXzEuMC4xNyAgICAgICAgICAKIFsxM10gZ2VuZXJpY3NfMC4xLjMgICAgICAgICAgICAgIHRpbWVyZWdfMi4wLjQgICAgICAgICAgICAgICB0Z3BfMi40LTIxICAgICAgICAgICAgICAgICAKIFsxNl0gVEguZGF0YV8xLjEtMSAgICAgICAgICAgICAgIFJTUUxpdGVfMi4yLjIwICAgICAgICAgICAgICBwb2xzcGxpbmVfMS4xLjIwICAgICAgICAgICAKIFsxOV0gcHJveHlfMC40LTI3ICAgICAgICAgICAgICAgIGZ1dHVyZV8xLjMxLjAgICAgICAgICAgICAgICBiaXRfNC4wLjQgICAgICAgICAgICAgICAgICAKIFsyMl0gdHpkYl8wLjMuMCAgICAgICAgICAgICAgICAgIHhtbDJfMS4zLjMgICAgICAgICAgICAgICAgICBhc3NlcnR0aGF0XzAuMi4xICAgICAgICAgICAKIFsyNV0geGZ1bl8wLjMzICAgICAgICAgICAgICAgICAgIGhtc18xLjEuMiAgICAgICAgICAgICAgICAgICBldmFsdWF0ZV8wLjIwICAgICAgICAgICAgICAKIFsyOF0gZmFuc2lfMS4wLjMgICAgICAgICAgICAgICAgIHByb2dyZXNzXzEuMi4yICAgICAgICAgICAgICBkYnBseXJfMi4yLjEgICAgICAgICAgICAgICAKIFszMV0ga20uY2lfMC41LTYgICAgICAgICAgICAgICAgIERCSV8xLjEuMyAgICAgICAgICAgICAgICAgICBnZW5lcGxvdHRlcl8xLjc2LjAgICAgICAgICAKIFszNF0gaHRtbHdpZGdldHNfMS41LjQgICAgICAgICAgIHJlc2hhcGVfMC44LjkgICAgICAgICAgICAgICBwdXJycl8xLjAuMSAgICAgICAgICAgICAgICAKIFszN10gZWxsaXBzaXNfMC4zLjIgICAgICAgICAgICAgIG1scjNkYXRhXzAuNi4xICAgICAgICAgICAgICBSU3BlY3RyYV8wLjE2LTEgICAgICAgICAgICAKIFs0MF0gYmFja3BvcnRzXzEuNC4xICAgICAgICAgICAgIGFubm90YXRlXzEuNzYuMCAgICAgICAgICAgICBiaW9tYVJ0XzIuNTQuMCAgICAgICAgICAgICAKIFs0M10gZGVsZGlyXzEuMC02ICAgICAgICAgICAgICAgIHZjdHJzXzAuNS4xICAgICAgICAgICAgICAgICBxdWFudHJlZ181Ljk0ICAgICAgICAgICAgICAKIFs0Nl0gYWJpbmRfMS40LTUgICAgICAgICAgICAgICAgIGNhY2hlbV8xLjAuNiAgICAgICAgICAgICAgICB3aXRocl8yLjUuMCAgICAgICAgICAgICAgICAKIFs0OV0gbWxyM2xlYXJuZXJzXzAuNS42ICAgICAgICAgIGNoZWNrbWF0ZV8yLjEuMCAgICAgICAgICAgICBwcmV0dHl1bml0c18xLjEuMSAgICAgICAgICAKIFs1Ml0gbWxyM2ZzZWxlY3RfMC45LjEgICAgICAgICAgIHBhcmFtNl8wLjIuNCAgICAgICAgICAgICAgICBjbHVzdGVyXzIuMS4zICAgICAgICAgICAgICAKIFs1NV0gY3JheW9uXzEuNS4yICAgICAgICAgICAgICAgIHBrZ2NvbmZpZ18yLjAuMyAgICAgICAgICAgICBubG1lXzMuMS0xNTcgICAgICAgICAgICAgICAKIFs1OF0gbWxlZ3BfMy4xLjkgICAgICAgICAgICAgICAgIG5uZXRfNy4zLTE3ICAgICAgICAgICAgICAgICBybGFuZ18xLjAuNiAgICAgICAgICAgICAgICAKIFs2MV0gZ2xvYmFsc18wLjE2LjIgICAgICAgICAgICAgIGxpZmVjeWNsZV8xLjAuMyAgICAgICAgICAgICBNYXRyaXhNb2RlbHNfMC41LTEgICAgICAgICAKIFs2NF0gc2FuZHdpY2hfMy4wLTIgICAgICAgICAgICAgIGRvd25sb2FkZXJfMC40ICAgICAgICAgICAgICBmaWxlbG9ja18xLjAuMiAgICAgICAgICAgICAKIFs2N10gcGFsbWVycGVuZ3VpbnNfMC4xLjEgICAgICAgIEJpb2NGaWxlQ2FjaGVfMi42LjAgICAgICAgICBtZXRzXzEuMy4xICAgICAgICAgICAgICAgICAKIFs3MF0gZG9TTk9XXzEuMC4yMCAgICAgICAgICAgICAgIEtNc3Vydl8wLjEtNSAgICAgICAgICAgICAgICBjYXJEYXRhXzMuMC01ICAgICAgICAgICAgICAKIFs3M10gYm9vdF8xLjMtMjggICAgICAgICAgICAgICAgIHpvb18xLjgtMTEgICAgICAgICAgICAgICAgICBiYXNlNjRlbmNfMC4xLTMgICAgICAgICAgICAKIFs3Nl0gcG5nXzAuMS04ICAgICAgICAgICAgICAgICAgIGJpdG9wc18xLjAtNyAgICAgICAgICAgICAgICBCaW9zdHJpbmdzXzIuNjYuMCAgICAgICAgICAKIFs3OV0gYmxvYl8xLjIuMyAgICAgICAgICAgICAgICAgIHNoYXBlXzEuNC42ICAgICAgICAgICAgICAgICBwYXJhZG94XzAuMTEuMCAgICAgICAgICAgICAKIFs4Ml0gc3RyaW5ncl8xLjUuMCAgICAgICAgICAgICAgIHBhcmFsbGVsbHlfMS4zNC4wICAgICAgICAgICByZWFkcl8yLjEuMyAgICAgICAgICAgICAgICAKIFs4NV0ganBlZ18wLjEtOSAgICAgICAgICAgICAgICAgIHJzdGF0aXhfMC43LjEgICAgICAgICAgICAgICBkaWN0aW9uYXI2XzAuMS4zICAgICAgICAgICAKIFs4OF0gZ2dzaWduaWZfMC42LjQgICAgICAgICAgICAgIHNjYWxlc18xLjIuMSAgICAgICAgICAgICAgICBtZW1vaXNlXzIuMC4xICAgICAgICAgICAgICAKIFs5MV0gbWFncml0dHJfMi4wLjMgICAgICAgICAgICAgIHBseXJfMS44LjggICAgICAgICAgICAgICAgICB6bGliYmlvY18xLjQ0LjAgICAgICAgICAgICAKIFs5NF0gY29tcGlsZXJfNC4yLjEgICAgICAgICAgICAgIFJDb2xvckJyZXdlcl8xLjEtMyAgICAgICAgICBjbHVlXzAuMy02MyAgICAgICAgICAgICAgICAKIFs5N10gbG1lNF8xLjEtMzEgICAgICAgICAgICAgICAgIHNldDZfMC4yLjUgICAgICAgICAgICAgICAgICBjbGlfMy40LjEgICAgICAgICAgICAgICAgICAKWzEwMF0gWFZlY3Rvcl8wLjM4LjAgICAgICAgICAgICAgIG1scjN0dW5pbmdzcGFjZXNfMC4zLjMgICAgICBtbHIzZmlsdGVyc18wLjcuMCAgICAgICAgICAKWzEwM10gbGlzdGVudl8wLjkuMCAgICAgICAgICAgICAgIGh0bWxUYWJsZV8yLjQuMSAgICAgICAgICAgICB0aWR5c2VsZWN0XzEuMi4wICAgICAgICAgICAKWzEwNl0gc3RyaW5naV8xLjcuMTIgICAgICAgICAgICAgIFRDR0FiaW9saW5rc0dVSS5kYXRhXzEuMTguMCBkaXN0cjZfMS42LjEzICAgICAgICAgICAgICAKWzEwOV0geWFtbF8yLjMuNSAgICAgICAgICAgICAgICAgIGFza3Bhc3NfMS4xICAgICAgICAgICAgICAgICBsb2NmaXRfMS41LTkuNiAgICAgICAgICAgICAKWzExMl0gbGF0dGljZUV4dHJhXzAuNi0zMCAgICAgICAgIHN1cnZNaXNjXzAuNS42ICAgICAgICAgICAgICBncmlkXzQuMi4xICAgICAgICAgICAgICAgICAKWzExNV0gbWFwdHJlZV8xLjQtOCAgICAgICAgICAgICAgIHRvb2xzXzQuMi4xICAgICAgICAgICAgICAgICBtbHIzbWlzY18wLjExLjAgICAgICAgICAgICAKWzExOF0gbWxyM2NsdXN0ZXJfMC4xLjYgICAgICAgICAgIGZ1dHVyZS5hcHBseV8xLjEwLjAgICAgICAgICBwYXJhbGxlbF80LjIuMSAgICAgICAgICAgICAKWzEyMV0gbWF0cml4Y2FsY18xLjAtNiAgICAgICAgICAgIHJzdHVkaW9hcGlfMC4xNCAgICAgICAgICAgICB1dWlkXzEuMS0wICAgICAgICAgICAgICAgICAKWzEyNF0gZm9yZWFjaF8xLjUuMiAgICAgICAgICAgICAgIGZvcmVpZ25fMC44LTgyICAgICAgICAgICAgICBncmlkRXh0cmFfMi4zICAgICAgICAgICAgICAKWzEyN10gcHJvZGxpbV8yMDE5LjExLjEzICAgICAgICAgIFJ0c25lXzAuMTYgICAgICAgICAgICAgICAgICBkaWdlc3RfMC42LjMxICAgICAgICAgICAgICAKWzEzMF0gbGF2YV8xLjcuMCAgICAgICAgICAgICAgICAgIGNtcHJza18yLjItMTEgICAgICAgICAgICAgICBSY3BwXzEuMC4xMCAgICAgICAgICAgICAgICAKWzEzM10gY2FyXzMuMS0xICAgICAgICAgICAgICAgICAgIGJyb29tXzEuMC4xICAgICAgICAgICAgICAgICBodHRyXzEuNC40ICAgICAgICAgICAgICAgICAKWzEzNl0gQW5ub3RhdGlvbkRiaV8xLjYwLjAgICAgICAgIG1scjN0dW5pbmdfMC4xNy4yICAgICAgICAgICBjb2xvcnNwYWNlXzIuMC0zICAgICAgICAgICAKWzEzOV0gcnZlc3RfMS4wLjMgICAgICAgICAgICAgICAgIFhNTF8zLjk5LTAuMTMgICAgICAgICAgICAgICByZXRpY3VsYXRlXzEuMjYgICAgICAgICAgICAKWzE0Ml0gdW1hcF8wLjIuOS4wICAgICAgICAgICAgICAgIHNwbGluZXNfNC4yLjEgICAgICAgICAgICAgICBsZ3JfMC40LjQgICAgICAgICAgICAgICAgICAKWzE0NV0gYmJvdGtfMC43LjIgICAgICAgICAgICAgICAgIHNtXzIuMi01LjcuMSAgICAgICAgICAgICAgICBzdGF0bW9kXzEuNC4zNyAgICAgICAgICAgICAKWzE0OF0gbWxyM3BpcGVsaW5lc18wLjQuMiAgICAgICAgIHh0YWJsZV8xLjgtNCAgICAgICAgICAgICAgICBubG9wdHJfMi4wLjMgICAgICAgICAgICAgICAKWzE1MV0ganNvbmxpdGVfMS44LjMgICAgICAgICAgICAgIGNvcnBjb3JfMS42LjEwICAgICAgICAgICAgICBjbHVzdGVyQ3JpdF8xLjIuOCAgICAgICAgICAKWzE1NF0gUjZfMi41LjEgICAgICAgICAgICAgICAgICAgIHBpbGxhcl8xLjguMSAgICAgICAgICAgICAgICBodG1sdG9vbHNfMC41LjMgICAgICAgICAgICAKWzE1N10gbWlucWFfMS4yLjUgICAgICAgICAgICAgICAgIGdsdWVfMS42LjIgICAgICAgICAgICAgICAgICBmYXN0bWFwXzEuMS4wICAgICAgICAgICAgICAKWzE2MF0gQmlvY1BhcmFsbGVsXzEuMzIuNSAgICAgICAgIGJlYW5wbG90XzEuMy4xICAgICAgICAgICAgICBjbGFzc183LjMtMjAgICAgICAgICAgICAgICAKWzE2M10gb29wbGFoXzAuMi4wICAgICAgICAgICAgICAgIGNvZGV0b29sc18wLjItMTggICAgICAgICAgICB1dGY4XzEuMi4yICAgICAgICAgICAgICAgICAKWzE2Nl0gdGliYmxlXzMuMS44ICAgICAgICAgICAgICAgIG51bURlcml2XzIwMTYuOC0xLjEgICAgICAgICBjdXJsXzQuMy4zICAgICAgICAgICAgICAgICAKWzE2OV0gbWxyM3Zpel8wLjYuMSAgICAgICAgICAgICAgIG9wZW5zc2xfMi4wLjMgICAgICAgICAgICAgICBpbnRlcnBfMS4xLTMgICAgICAgICAgICAgICAKWzE3Ml0gcGVuYWxpemVkU1ZNXzEuMS4zICAgICAgICAgIHJtYXJrZG93bl8yLjE3ICAgICAgICAgICAgICBtdW5zZWxsXzAuNS4wICAgICAgICAgICAgICAKWzE3NV0gZTEwNzFfMS43LTEyICAgICAgICAgICAgICAgIEdlbm9tZUluZm9EYkRhdGFfMS4yLjkgICAgICBpdGVyYXRvcnNfMS4wLjE0ICAgICAgICAgICAKWzE3OF0gZ3RhYmxlXzAuMy4xICAgICAgICAgICAgICAgCmBgYAoKIyBSZWZlcmVuY2VzCgo=